-- Logs begin at Mon 2022-09-05 09:59:41 UTC, end at Mon 2022-09-05 10:54:51 UTC. -- Sep 05 10:24:21.966986 dv-cinder-850831-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 05 10:24:21.975481 dv-cinder-850831-4-smb devstack@keystone.service[81460]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 10:24:21 2022] *** Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: nodename: dv-cinder-850831-4-smb Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: machine: x86_64 Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: clock source: unix Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: pcre jit disabled Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: detected number of CPU cores: 4 Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: current working directory: / Sep 05 10:24:21.977555 dv-cinder-850831-4-smb devstack@keystone.service[81460]: detected binary path: /usr/bin/uwsgi-core Sep 05 10:24:21.978095 dv-cinder-850831-4-smb devstack@keystone.service[81460]: your processes number limit is 47680 Sep 05 10:24:21.978095 dv-cinder-850831-4-smb devstack@keystone.service[81460]: your memory page size is 4096 bytes Sep 05 10:24:21.978095 dv-cinder-850831-4-smb devstack@keystone.service[81460]: detected max file descriptor number: 2048 Sep 05 10:24:21.978095 dv-cinder-850831-4-smb devstack@keystone.service[81460]: lock engine: pthread robust mutexes Sep 05 10:24:21.978095 dv-cinder-850831-4-smb devstack@keystone.service[81460]: thunder lock: enabled Sep 05 10:24:21.978095 dv-cinder-850831-4-smb devstack@keystone.service[81460]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 05 10:24:21.978095 dv-cinder-850831-4-smb devstack@keystone.service[81460]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 10:24:22.018053 dv-cinder-850831-4-smb devstack@keystone.service[81460]: Python main interpreter initialized at 0x55d4b88dc9c0 Sep 05 10:24:22.018053 dv-cinder-850831-4-smb devstack@keystone.service[81460]: python threads support enabled Sep 05 10:24:22.018053 dv-cinder-850831-4-smb devstack@keystone.service[81460]: your server socket listen backlog is limited to 100 connections Sep 05 10:24:22.018053 dv-cinder-850831-4-smb devstack@keystone.service[81460]: your mercy for graceful operations on workers is 90 seconds Sep 05 10:24:22.018415 dv-cinder-850831-4-smb devstack@keystone.service[81460]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 10:24:22.018492 dv-cinder-850831-4-smb devstack@keystone.service[81460]: *** Operational MODE: preforking *** Sep 05 10:24:22.018727 dv-cinder-850831-4-smb devstack@keystone.service[81460]: *** uWSGI is running in multiple interpreter mode *** Sep 05 10:24:22.018727 dv-cinder-850831-4-smb devstack@keystone.service[81460]: spawned uWSGI master process (pid: 81460) Sep 05 10:24:22.018920 dv-cinder-850831-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 05 10:24:22.020128 dv-cinder-850831-4-smb devstack@keystone.service[81460]: spawned uWSGI worker 1 (pid: 81472, cores: 1) Sep 05 10:24:22.022566 dv-cinder-850831-4-smb devstack@keystone.service[81460]: spawned uWSGI worker 2 (pid: 81474, cores: 1) Sep 05 10:24:22.022566 dv-cinder-850831-4-smb devstack@keystone.service[81460]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 10:24:26.350129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:24:26.350129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 05 10:24:26.350904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:24:26.350904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: from cryptography.utils import int_from_bytes Sep 05 10:24:26.356672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:24:26.356672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: from cryptography.utils import int_from_bytes Sep 05 10:24:26.357127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 10:24:26.357127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: from cryptography.utils import int_from_bytes Sep 05 10:24:26.401427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 10:24:26.401590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 10:24:26.401728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] command line args: [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 10:24:26.401997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 10:24:26.402174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ================================================================================ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 10:24:26.402427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.402748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_dir = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.402941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.403123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] config_source = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.403303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] debug = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.403498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.404027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.404113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.404311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.404557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.404781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.405001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_config_append = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.405143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.405320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_dir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.405444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 10:24:26.405550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.405652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 10:24:26.405779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.405856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] command line args: [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 10:24:26.405976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.406059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 10:24:26.406135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ================================================================================ {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 10:24:26.406249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.406405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] admin_token = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.406532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.406661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.406740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] config_dir = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.406861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.406947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] config_source = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] debug = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.407974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408168 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] list_limit = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] log_config_append = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.408954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] log_dir = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] log_file = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] publish_errors = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.409939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] standard_threads = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.410910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_journal = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_json = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.411948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_stderr = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.412040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.412118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] use_syslog = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.412194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.412336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.412447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.412587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.412823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.412941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.413079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.413155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] publish_errors = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.413321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.413447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.413556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.413630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.413732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.413813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.413978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.414062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.414211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.414292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.414448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] standard_threads = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.414530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.414679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.414765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.414922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.415003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.415098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.415180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.415273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] use_journal = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.415380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.415463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] use_json = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.415625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] use_stderr = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.415702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.415804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] use_syslog = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.415879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.416035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 10:24:26.416115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.416287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.416363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.416525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.416600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.416782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.416865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.417973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.418056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.418745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.418853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.418985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.419908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.420859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.421986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.422978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.423924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.424848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.425934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.426930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.427866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.428941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.429874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.430867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.431990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.432911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.433008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.433177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.433289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.433411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.433545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.433661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.433734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.434003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.434621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.434743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.434875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.435922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.436986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.437942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.external = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.438959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.password = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.439936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] auth.token = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.440993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.441927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] auth.external = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.442976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.443111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.443188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.443404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.443488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.443660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.443756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.443885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] auth.password = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] auth.token = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.444908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.445866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] credential.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.446978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.447965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.448931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.449008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.449163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.449241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.449394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.449495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.450227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.450371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.450518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.450634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.450720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.450871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.450950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.451939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.452913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.453856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.454944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.455993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.456941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.457929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.458855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.459988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460094 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.460945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461515 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.461980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.462923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.463890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464275 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.464999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.465099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.465838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.465971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.466910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.467894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.468994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.469939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.470954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.471913 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.472920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473713 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.473966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.474894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.475895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.476933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] role.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.477987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] role.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.478941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.479905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.480935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.481998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.482958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.483935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.484893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.485993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.486939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.487988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.488926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.489859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.490013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.490100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.490181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 10:24:26.490292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.490562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.connection = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.490808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.491058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.491297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.491538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.491798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.492037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.492274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.492512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.492758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.492997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.493240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.493476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.493724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.493959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.494202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.494685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.494929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.495164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 10:24:26.495334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 10:24:26.520669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.520898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.521174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.521769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.522002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.522227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.531121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.531310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.560716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.560942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.563752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.563981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.614894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.615042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.665053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.665233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.665385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.665622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.823119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.823344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.823565 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.823731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.823838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.823918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.824018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.824100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.824231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.824324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.824579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.824798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.848980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.849111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.849225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.849344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.849463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.849581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.849581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.861292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.861647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.874289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.874535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.874764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.874892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.874976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.875124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.875206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.875347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.875439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.875569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.875674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.875893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.876108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.876321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 10:24:26.892698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.892800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.892906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:24:26.893015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:24:26.893252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.893349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.893456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:24:26.893539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 10:24:26.893735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.893817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.894002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.894086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.894267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.894347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.894522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.894601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.904697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.904976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.905128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.905251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.905407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.905538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.905677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.905962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.912583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.912882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.915504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.915778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.915863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.916063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.916143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.916345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.916440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.916629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.916736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.916891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.917983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.918098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.918298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.918975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.919377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.941983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.942749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.943446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.943760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.944233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.944519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.948399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.948684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.948969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.949258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.949677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.949976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.955411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.955730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.956253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.956543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.961305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.961604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.961895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.962103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.962185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.962393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.962475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.962676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.962757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.962961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.963050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.963241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.963330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.963517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.963813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.964083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.979426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.979739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.980309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.980595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.984354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.985179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.987576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.987900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.988393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.988698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.992094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.992878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.995453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.996244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:26.998991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.999307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.999614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.999698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.999912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:26.999994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.000196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.000279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.000479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.000561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.000803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.001108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.017098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.017333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.017417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.017622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.017716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.017892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.017974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.018159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.024765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.024967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.026337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.026500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.028402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.028556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.028697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.028853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.031301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.031433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.031605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.031761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.031898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.032116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.032198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.032400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.032563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.032791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.044379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.044487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.044658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.044742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.044937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.045020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.045219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.045302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.045597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.045679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.045876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.045959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.046156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.046237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.061517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.061632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.064415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.064535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.067306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.067416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.068761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.068875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.070234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.070324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.070516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.070599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.070915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.071000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.077337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.077572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.078807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.079032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.081714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.081927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.082108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.082326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.082428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.082616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.082699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.082900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.091029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.091322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.091433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.091613 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.091702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.091933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.098434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.098716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.098798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 10:24:27.099001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.099084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.099277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.099376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.099567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.099675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.099871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.099954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.100145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.100240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.100419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.100511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.100686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.100776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.100962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.101042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.101240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.101323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.101516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.101599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.101780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.101860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.102050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.102130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.102319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 10:24:27.136933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d4b88dc9c0 pid: 81474 (default app) Sep 05 10:24:27.137224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d4b88dc9c0 pid: 81472 (default app) Sep 05 10:24:27.140352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2244c7-a0e4-4015-b8f3-d31f41ce47a4 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:27.140645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2244c7-a0e4-4015-b8f3-d31f41ce47a4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:27.140922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2244c7-a0e4-4015-b8f3-d31f41ce47a4 None None] PATH_INFO: `/v3` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:27.145058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Mon Sep 5 10:24:27 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:33.715041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98645d8-8242-4785-9e53-8c6b2f4a6095 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:33.715618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98645d8-8242-4785-9e53-8c6b2f4a6095 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:33.715730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98645d8-8242-4785-9e53-8c6b2f4a6095 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:33.720900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:24:33.725947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:33.726476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:33.726476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:33.797288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: INFO dbcounter [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] Registered counter for database keystone Sep 05 10:24:33.815996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG oslo_db.sqlalchemy.engines [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 10:24:33.822334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writer thread running {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 10:24:34.002551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG passlib.handlers.bcrypt [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81474) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 10:24:34.002952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG passlib.handlers.bcrypt [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81474) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 10:24:34.061513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:34.063123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:34.192783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 10:24:34.658362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98645d8-8242-4785-9e53-8c6b2f4a6095 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:34.730304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: INFO dbcounter [None req-a98645d8-8242-4785-9e53-8c6b2f4a6095 None None] Registered counter for database keystone Sep 05 10:24:34.753410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG oslo_db.sqlalchemy.engines [None req-a98645d8-8242-4785-9e53-8c6b2f4a6095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 10:24:34.759438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writer thread running {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 10:24:34.883759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98645d8-8242-4785-9e53-8c6b2f4a6095 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:34.888711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf19cf4-1efa-41f1-bf76-219cd13161ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:34.889342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19cf4-1efa-41f1-bf76-219cd13161ce admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:34.889624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19cf4-1efa-41f1-bf76-219cd13161ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:34.889898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf19cf4-1efa-41f1-bf76-219cd13161ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:34.898015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf19cf4-1efa-41f1-bf76-219cd13161ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:34.950189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING keystone.common.rbac_enforcer.enforcer [None req-baf19cf4-1efa-41f1-bf76-219cd13161ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 10:24:34.950514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf19cf4-1efa-41f1-bf76-219cd13161ce admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:34.959956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Sep 5 10:24:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:24:34.966488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:34.981419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82565a0-2142-4852-86a0-d22491d65950 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:34.985870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a5f2b-3963-45e5-8b5e-e2a8c15f2936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:34.986965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a5f2b-3963-45e5-8b5e-e2a8c15f2936 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:34.987248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a5f2b-3963-45e5-8b5e-e2a8c15f2936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:34.987522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a5f2b-3963-45e5-8b5e-e2a8c15f2936 admin admin] PATH_INFO: `/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:34.989128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a5f2b-3963-45e5-8b5e-e2a8c15f2936 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5319c7dfcf94967b47c42ebfecd5d8f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:35.041641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ab1a5f2b-3963-45e5-8b5e-e2a8c15f2936 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 10:24:35.041985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a5f2b-3963-45e5-8b5e-e2a8c15f2936 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:35.051411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Mon Sep 5 10:24:34 2022] GET /identity/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:36.950898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726df2-89a5-43aa-bd9a-ef1548dee552 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:36.951445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726df2-89a5-43aa-bd9a-ef1548dee552 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:36.951445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9726df2-89a5-43aa-bd9a-ef1548dee552 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:36.955513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:36.961037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95954-84b5-42ad-a3e1-31831bfb2366 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:36.961439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95954-84b5-42ad-a3e1-31831bfb2366 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:36.961595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95954-84b5-42ad-a3e1-31831bfb2366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:36.982500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b0b95954-84b5-42ad-a3e1-31831bfb2366 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:36.984061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b0b95954-84b5-42ad-a3e1-31831bfb2366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:36.991868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 10:24:37.269086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726df2-89a5-43aa-bd9a-ef1548dee552 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:37.282218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9726df2-89a5-43aa-bd9a-ef1548dee552 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:37.286356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478d37-787e-4407-ae66-d37c4957dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:37.287094 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478d37-787e-4407-ae66-d37c4957dc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:37.287382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478d37-787e-4407-ae66-d37c4957dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:37.287736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478d37-787e-4407-ae66-d37c4957dc83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:37.295541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478d37-787e-4407-ae66-d37c4957dc83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:37.297422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478d37-787e-4407-ae66-d37c4957dc83 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:37.306261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Sep 5 10:24:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:24:37.312418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95954-84b5-42ad-a3e1-31831bfb2366 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:37.321386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95954-84b5-42ad-a3e1-31831bfb2366 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:37.326517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82118df-f273-421f-a641-abab09d9f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:37.327137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82118df-f273-421f-a641-abab09d9f1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:37.327418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82118df-f273-421f-a641-abab09d9f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:37.327735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82118df-f273-421f-a641-abab09d9f1d1 admin admin] PATH_INFO: `/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:37.329067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82118df-f273-421f-a641-abab09d9f1d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3cec9f43d2034445ba2c8aa17cc5e9b7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:37.330897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82118df-f273-421f-a641-abab09d9f1d1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:37.332439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Mon Sep 5 10:24:37 2022] GET /identity/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:39.304885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47ecd-9eff-48e3-8819-d7f28a222621 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:39.305406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47ecd-9eff-48e3-8819-d7f28a222621 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:39.305506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47ecd-9eff-48e3-8819-d7f28a222621 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:39.306760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:39.312319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808100b6-25e5-4a5f-ba80-ef80002c5742 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:39.312740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808100b6-25e5-4a5f-ba80-ef80002c5742 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:39.312880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808100b6-25e5-4a5f-ba80-ef80002c5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:39.331276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-808100b6-25e5-4a5f-ba80-ef80002c5742 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:39.332508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-808100b6-25e5-4a5f-ba80-ef80002c5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:39.351051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831180-27e3-467b-9d38-46a4a2a4930d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:39.351343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831180-27e3-467b-9d38-46a4a2a4930d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:39.351651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831180-27e3-467b-9d38-46a4a2a4930d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:39.352976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:24:39.358569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b5878-238e-443a-88aa-213523d9594a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:39.358859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b5878-238e-443a-88aa-213523d9594a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:39.359141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b5878-238e-443a-88aa-213523d9594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:39.401676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-b22b5878-238e-443a-88aa-213523d9594a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81472) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 10:24:39.401998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG passlib.handlers.bcrypt [None req-b22b5878-238e-443a-88aa-213523d9594a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81472) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 10:24:39.413161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:39.452129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b22b5878-238e-443a-88aa-213523d9594a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:39.453722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b22b5878-238e-443a-88aa-213523d9594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:39.552241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:24:39.685692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808100b6-25e5-4a5f-ba80-ef80002c5742 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:39.711252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:39.792322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808100b6-25e5-4a5f-ba80-ef80002c5742 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:39.823418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b5878-238e-443a-88aa-213523d9594a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:39.826411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:39.827059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:39.827345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:39.827692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:39.838828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:39.847928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:39.848901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:24:39.849833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:39.854685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:39.925286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b5878-238e-443a-88aa-213523d9594a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:39.927570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:39.937802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:39.956607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff6c4e-85f7-400a-b72f-a5770c547a8a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:39.965528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:39.966398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:39.966680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:39.966953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:39.994236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:39.995108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:39.995387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:39.995699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:39.997046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:39.997358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:39.998768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:40.011963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:40.018136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:40.037864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:40.039430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:40.121337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1506f-a87b-4b43-bdc2-05599f2bfaf3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:40.145048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 10:24:40.150715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:40.153526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:40.156126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:40.156771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:40.157103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:40.157377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] PATH_INFO: `/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:40.158827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] RBAC: Authorizing `identity:get_user(user_id=3cec9f43d2034445ba2c8aa17cc5e9b7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:40.160889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:40.162454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:40 2022] GET /identity/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:40.167871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:40.185712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:40.250365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa575ab3-9969-4dcf-bd1b-18167e86c6f4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:40.272440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45e819-93d7-4e23-9b27-e1f7633abd90 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:40.283079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:40.283964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:40.284249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:40.284524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:40.303647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:40.305118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:40.306591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:40.307223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:40.307504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:40.307807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:40.309464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:40.310917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:40.312487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:40.318707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:24:40.324130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:40.325204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:24:40.326018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:24:40.326018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:24:40.326018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:24:40.326018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:24:40.331308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:40.389609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:40.401937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:40.422150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077bb5f-01ca-4278-a8d8-59301277b2f9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:40.436497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26456-d6e1-4209-97d4-a0ca58c642e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:40.456413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82368fc-b2ad-435c-8cc9-5300a170f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:40.457019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82368fc-b2ad-435c-8cc9-5300a170f43a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:40.457306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82368fc-b2ad-435c-8cc9-5300a170f43a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:40.457586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82368fc-b2ad-435c-8cc9-5300a170f43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:40.458321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82368fc-b2ad-435c-8cc9-5300a170f43a None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.domain.id=default, user.id=3cec9f43d2034445ba2c8aa17cc5e9b7) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:40.458633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82368fc-b2ad-435c-8cc9-5300a170f43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:40.460133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82368fc-b2ad-435c-8cc9-5300a170f43a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:40.467076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Sep 5 10:24:40 2022] GET /identity/v3/role_assignments?user.id=3cec9f43d2034445ba2c8aa17cc5e9b7&scope.domain.id=default&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:40.470097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33324a-32bd-45d8-818a-758fd2824ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:40.470716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33324a-32bd-45d8-818a-758fd2824ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:40.470997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33324a-32bd-45d8-818a-758fd2824ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:40.471272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33324a-32bd-45d8-818a-758fd2824ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:40.471971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33324a-32bd-45d8-818a-758fd2824ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:40.472276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33324a-32bd-45d8-818a-758fd2824ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:40.473721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33324a-32bd-45d8-818a-758fd2824ab8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:40.493874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:42.509898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595a4e-7ef6-4e45-aac2-412ef778925d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:42.510426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595a4e-7ef6-4e45-aac2-412ef778925d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:42.510426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595a4e-7ef6-4e45-aac2-412ef778925d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:42.512349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:42.518081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b365b2-2530-4946-932f-4301538a241e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:42.518514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b365b2-2530-4946-932f-4301538a241e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:42.518683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b365b2-2530-4946-932f-4301538a241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:42.546506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-90b365b2-2530-4946-932f-4301538a241e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:42.547739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-90b365b2-2530-4946-932f-4301538a241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:42.636156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:42.897258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3ecc-12e5-4977-a7fd-1dfb8acfd580 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:42.897601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3ecc-12e5-4977-a7fd-1dfb8acfd580 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:42.897707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3ecc-12e5-4977-a7fd-1dfb8acfd580 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:42.899045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:42.905134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5147b-4612-4f13-8c4a-3b07ee8adbf7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:42.905426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5147b-4612-4f13-8c4a-3b07ee8adbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:42.905699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5147b-4612-4f13-8c4a-3b07ee8adbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:42.932601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d7a5147b-4612-4f13-8c4a-3b07ee8adbf7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:42.934028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7a5147b-4612-4f13-8c4a-3b07ee8adbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:42.998140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:43.033496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:43.042881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afefe2-8d61-4f4a-b5b9-116224cc2828 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.043783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afefe2-8d61-4f4a-b5b9-116224cc2828 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.044275 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afefe2-8d61-4f4a-b5b9-116224cc2828 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.045843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:24:43.061357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee4866-9f16-4462-b43c-71f1dc25a367 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.061647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee4866-9f16-4462-b43c-71f1dc25a367 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.061927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee4866-9f16-4462-b43c-71f1dc25a367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.092712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7bee4866-9f16-4462-b43c-71f1dc25a367 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:43.093914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7bee4866-9f16-4462-b43c-71f1dc25a367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:43.123271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afefe2-8d61-4f4a-b5b9-116224cc2828 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:43.193554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:43.223948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af97d-45b2-48e9-960f-968698bbc840 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.224472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af97d-45b2-48e9-960f-968698bbc840 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.224894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af97d-45b2-48e9-960f-968698bbc840 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.226795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:43.231931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1744b-437a-4846-9d8f-2dd402d510b1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.232244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1744b-437a-4846-9d8f-2dd402d510b1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.232497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1744b-437a-4846-9d8f-2dd402d510b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.254245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-06e1744b-437a-4846-9d8f-2dd402d510b1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:43.255461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-06e1744b-437a-4846-9d8f-2dd402d510b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:43.348278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afefe2-8d61-4f4a-b5b9-116224cc2828 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:43.361171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:24:43.407080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:43.407776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.408064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.408340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.425292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:43.430672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:43.431509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:24:43.432302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:43.438652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1744b-437a-4846-9d8f-2dd402d510b1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:43.458816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:43.468860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:43.505691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:43.630553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1744b-437a-4846-9d8f-2dd402d510b1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:43.690899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8950-18c2-437c-bad9-05c4a98eed31 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:43.693706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:43.694319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.694598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.694866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.695532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:43.696036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:43.697419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:43.721513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:43.723135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:43.755622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:43.756245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.756523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.756795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.757468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:43.758855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:43.877681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:43.882064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28770e-6ff9-4e9d-8414-c76026155541 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:43.913371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 16/32] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Sep 5 10:24:43 2022] POST /identity/v3/roles => generated 219 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:24:43.914234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:43.930077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:43.930738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:43.931125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:43.931400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:43.954166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:43.955905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:24:43.982681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:43.983573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:24:43.984425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:24:43.984425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:24:43.984425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:24:43.984425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:43.984638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:44.027623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:44.109141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32600e3d-1e63-4461-8a11-68187ec2473e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:44.122129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46406ab4-b3d6-4a51-bd2f-4cbf449d3392 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:44.147762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:44.149812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.150099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.150372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.151069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:44.153112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:44.188695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:44.189723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.190211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.190689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] PATH_INFO: `/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.192296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] RBAC: Authorizing `identity:get_user(user_id=3cec9f43d2034445ba2c8aa17cc5e9b7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:44.194207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:44.196145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:43 2022] GET /identity/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:44.197106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:44.314945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Sep 5 10:24:43 2022] POST /identity/v3/roles => generated 225 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:44.316457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:44.317652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934aca2-3766-40b6-b8b1-29ec3fe3848b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:44.331994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:44.351419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:44.363943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:44.364583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.364866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.365139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.365815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:44.366120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:44.368495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:44.400749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 18/36] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:44.407366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:44.446082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283698a-bf3b-4888-9aab-1aa8002946f2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:44.488818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:44.489967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.490570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.491051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.493762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:44.495937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:44.498541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 19/37] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:44.503720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:44.572453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a28bd-4350-4eb5-9543-cb98b5282c99 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:44.611949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:44.616988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b58a6-3706-4c81-ac50-be4655564f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:44.617563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b58a6-3706-4c81-ac50-be4655564f28 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.617904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b58a6-3706-4c81-ac50-be4655564f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.618140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b58a6-3706-4c81-ac50-be4655564f28 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.618987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b58a6-3706-4c81-ac50-be4655564f28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:44.620740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b58a6-3706-4c81-ac50-be4655564f28 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:44.634622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8606d-e32d-4409-9503-c631ae5ed4c0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:44.650459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 19/38] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:24:44 2022] POST /identity/v3/projects => generated 301 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:44.651783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887738d-35c9-4f8f-bb28-ed12263c8757 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.652076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887738d-35c9-4f8f-bb28-ed12263c8757 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.652356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887738d-35c9-4f8f-bb28-ed12263c8757 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.654791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 20/39] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:44.655794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cc86a-79ce-495c-ae70-4c2b0add39f6 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.656071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cc86a-79ce-495c-ae70-4c2b0add39f6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.656341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cc86a-79ce-495c-ae70-4c2b0add39f6 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.657761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 21/40] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:44.663046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5a94-3938-4479-b2d5-3e22325fac66 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.663356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5a94-3938-4479-b2d5-3e22325fac66 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.664248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5a94-3938-4479-b2d5-3e22325fac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.680491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105816a-dc45-48e3-92c2-d2b4e3367837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:44.681191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105816a-dc45-48e3-92c2-d2b4e3367837 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.681474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105816a-dc45-48e3-92c2-d2b4e3367837 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.681753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105816a-dc45-48e3-92c2-d2b4e3367837 None admin] PATH_INFO: `/v3/domains/default/users/3cec9f43d2034445ba2c8aa17cc5e9b7/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.683144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c8bc5a94-3938-4479-b2d5-3e22325fac66 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:44.684415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105816a-dc45-48e3-92c2-d2b4e3367837 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3cec9f43d2034445ba2c8aa17cc5e9b7, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:44.685162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c8bc5a94-3938-4479-b2d5-3e22325fac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:44.685914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105816a-dc45-48e3-92c2-d2b4e3367837 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:44.704560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 20/41] 10.222.0.16 () {58 vars in 1361 bytes} [Mon Sep 5 10:24:44 2022] PUT /identity/v3/domains/default/users/3cec9f43d2034445ba2c8aa17cc5e9b7/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:24:44.706289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd53f-d60a-4c70-b7d6-f42205f7b08d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:44.706591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd53f-d60a-4c70-b7d6-f42205f7b08d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:44.706873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd53f-d60a-4c70-b7d6-f42205f7b08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:44.732045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e88dd53f-d60a-4c70-b7d6-f42205f7b08d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:44.734264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e88dd53f-d60a-4c70-b7d6-f42205f7b08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:44.747311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:44.783679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:44.839209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:45.058037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5a94-3938-4479-b2d5-3e22325fac66 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:45.117014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd53f-d60a-4c70-b7d6-f42205f7b08d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:45.173649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5a94-3938-4479-b2d5-3e22325fac66 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:45.196477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:45.217757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:45.218376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:45.218657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:45.218932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:45.219632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:45.221068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:45.234005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd53f-d60a-4c70-b7d6-f42205f7b08d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:45.239627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Sep 5 10:24:45 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:45.279242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28447fa8-095e-4314-90af-b9a329420e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:45.279965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447fa8-095e-4314-90af-b9a329420e27 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:45.280256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447fa8-095e-4314-90af-b9a329420e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:45.280557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447fa8-095e-4314-90af-b9a329420e27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:45.281754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28447fa8-095e-4314-90af-b9a329420e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:45.283270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28447fa8-095e-4314-90af-b9a329420e27 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:45.285160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:45.290813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:45.439121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:45.505126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ea692-c43b-4f1c-a343-108fc952ca8f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:45.537475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a970-342b-4e4e-bfb4-ce09d67d27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:45.538083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a970-342b-4e4e-bfb4-ce09d67d27aa None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:45.538368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a970-342b-4e4e-bfb4-ce09d67d27aa None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:45.538646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a970-342b-4e4e-bfb4-ce09d67d27aa None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:45.539301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a970-342b-4e4e-bfb4-ce09d67d27aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:45.540804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a970-342b-4e4e-bfb4-ce09d67d27aa None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:45.567351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:24:45 2022] POST /identity/v3/projects => generated 312 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:46.651461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a4fa-b04a-44d7-82cb-96ad321a6417 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:46.652000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a4fa-b04a-44d7-82cb-96ad321a6417 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:46.652164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126a4fa-b04a-44d7-82cb-96ad321a6417 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:46.654497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:46.659688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6da2-788a-48bb-989c-d14ddb66ef31 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:46.660102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6da2-788a-48bb-989c-d14ddb66ef31 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:46.660260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6da2-788a-48bb-989c-d14ddb66ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:46.678855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-59fb6da2-788a-48bb-989c-d14ddb66ef31 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:46.680097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-59fb6da2-788a-48bb-989c-d14ddb66ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:46.745381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:47.016331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126a4fa-b04a-44d7-82cb-96ad321a6417 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:47.221158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126a4fa-b04a-44d7-82cb-96ad321a6417 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:47.255344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:47.256006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:47.256293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:47.256573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:47.260156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:47.269105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:47.275407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:47.276411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:24:47.277195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:47.282831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb6da2-788a-48bb-989c-d14ddb66ef31 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:47.300850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:47.384586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb6da2-788a-48bb-989c-d14ddb66ef31 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:47.419618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6850-58a1-481a-8923-6fcdfbb6641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:47.420232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6850-58a1-481a-8923-6fcdfbb6641e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:47.420521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6850-58a1-481a-8923-6fcdfbb6641e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:47.420804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6850-58a1-481a-8923-6fcdfbb6641e None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:47.421483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6850-58a1-481a-8923-6fcdfbb6641e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:47.421796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6850-58a1-481a-8923-6fcdfbb6641e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:47.423196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6850-58a1-481a-8923-6fcdfbb6641e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:47.431366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:47.436933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:47.477578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78877-429c-4ca1-9058-1b739b8f769d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:47.477875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78877-429c-4ca1-9058-1b739b8f769d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:47.478167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78877-429c-4ca1-9058-1b739b8f769d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:47.479509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 27/51] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:24:47.484925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1829-22de-4f85-a9e8-dc0ced742c9c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:47.485212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1829-22de-4f85-a9e8-dc0ced742c9c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:47.485495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1829-22de-4f85-a9e8-dc0ced742c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:47.503820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-55be1829-22de-4f85-a9e8-dc0ced742c9c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:47.505014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-55be1829-22de-4f85-a9e8-dc0ced742c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:47.541758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab253-8a7a-49af-8c90-ec7e283a7830 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:47.574982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 28/52] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:47.576037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:47.576699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:47.576985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:47.577267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] PATH_INFO: `/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:47.578497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] RBAC: Authorizing `identity:get_user(user_id=3cec9f43d2034445ba2c8aa17cc5e9b7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:47.580005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:47.581714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 25/53] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:47 2022] GET /identity/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:47.587237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1829-22de-4f85-a9e8-dc0ced742c9c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:47.598497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:47.692096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1829-22de-4f85-a9e8-dc0ced742c9c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:47.725853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:47.726488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:47.726776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:47.727057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:47.728219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:47.729692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:47.733861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 29/54] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:47.740966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:47.826759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:47.852835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:47.876869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b88a23-5b0f-40b2-ad19-9daccc8d8f68 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:47.915526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:47.916641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:47.916641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:47.916846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:47.917425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.domain.id=default, user.id=3cec9f43d2034445ba2c8aa17cc5e9b7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:47.917737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:47.920130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:47.929220 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 26/55] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Sep 5 10:24:47 2022] GET /identity/v3/role_assignments?user.id=3cec9f43d2034445ba2c8aa17cc5e9b7&scope.domain.id=default&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 530 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:47.941369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:47.968666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfb8a5-b9a0-4e8b-9c8b-526791e9c10b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:48.010502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3ae51-d50b-4e39-a98a-9e58190dccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:48.011174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3ae51-d50b-4e39-a98a-9e58190dccfb None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:48.011455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3ae51-d50b-4e39-a98a-9e58190dccfb None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:48.013400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3ae51-d50b-4e39-a98a-9e58190dccfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:48.014809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3ae51-d50b-4e39-a98a-9e58190dccfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:48.016352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3ae51-d50b-4e39-a98a-9e58190dccfb None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:48.017985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 30/56] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:48.031208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:48.161809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611012a6-cd63-46eb-b568-faef7d437854 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:48.189143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:48.197451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a7315-4342-4774-b7cd-51e7f7ecf8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:48.198074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a7315-4342-4774-b7cd-51e7f7ecf8bc None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:48.198359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a7315-4342-4774-b7cd-51e7f7ecf8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:48.198639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a7315-4342-4774-b7cd-51e7f7ecf8bc None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:48.199844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a7315-4342-4774-b7cd-51e7f7ecf8bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:48.201300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a7315-4342-4774-b7cd-51e7f7ecf8bc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:48.233132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 27/57] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Sep 5 10:24:48 2022] POST /identity/v3/projects => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:50.175550 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6199f9-ab1e-41e4-a7fd-3252dfeba2fa None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:50.176040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6199f9-ab1e-41e4-a7fd-3252dfeba2fa None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:50.176121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6199f9-ab1e-41e4-a7fd-3252dfeba2fa None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:50.177474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 31/58] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:50.182652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de067-c386-4bba-967d-5fc3fe0cda8b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:50.183065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de067-c386-4bba-967d-5fc3fe0cda8b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:50.183216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de067-c386-4bba-967d-5fc3fe0cda8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:50.201089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c78de067-c386-4bba-967d-5fc3fe0cda8b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:50.202278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c78de067-c386-4bba-967d-5fc3fe0cda8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:50.266805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 28/59] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:50.543130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6199f9-ab1e-41e4-a7fd-3252dfeba2fa None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:50.642334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6199f9-ab1e-41e4-a7fd-3252dfeba2fa None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:50.674649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5e490-6c27-42c1-94bf-9638d80b5da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:50.675265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5e490-6c27-42c1-94bf-9638d80b5da1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:50.675548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5e490-6c27-42c1-94bf-9638d80b5da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:50.675854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5e490-6c27-42c1-94bf-9638d80b5da1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:50.676963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5e490-6c27-42c1-94bf-9638d80b5da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:50.678405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5e490-6c27-42c1-94bf-9638d80b5da1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:50.679972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 32/60] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:50.685989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de067-c386-4bba-967d-5fc3fe0cda8b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:50.781329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de067-c386-4bba-967d-5fc3fe0cda8b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:50.791496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:50.816356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43845395-d69a-4643-aceb-81bc1d507d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:50.816902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845395-d69a-4643-aceb-81bc1d507d2a None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:50.817190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845395-d69a-4643-aceb-81bc1d507d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:50.817468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43845395-d69a-4643-aceb-81bc1d507d2a None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:50.818120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43845395-d69a-4643-aceb-81bc1d507d2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:50.819557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43845395-d69a-4643-aceb-81bc1d507d2a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:50.845577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 29/61] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:24:50 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:53.887421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909334-6802-485c-b63d-8916b28373e6 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:53.888297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909334-6802-485c-b63d-8916b28373e6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:53.888725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909334-6802-485c-b63d-8916b28373e6 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:53.890217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 33/62] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:53.903609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452971c-2f7d-46d1-a70c-652f290342df None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:53.904100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452971c-2f7d-46d1-a70c-652f290342df None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:53.904207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452971c-2f7d-46d1-a70c-652f290342df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:53.931449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f452971c-2f7d-46d1-a70c-652f290342df None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:53.932676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f452971c-2f7d-46d1-a70c-652f290342df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:54.021284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 30/63] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:54.045143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a690d9-2e3d-4601-bca2-2e59653d79c1 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.045756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a690d9-2e3d-4601-bca2-2e59653d79c1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.046281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a690d9-2e3d-4601-bca2-2e59653d79c1 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.050837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 34/64] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:54.053128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674723c5-c0ec-40e0-86f2-4f6283b2ad59 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.053427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674723c5-c0ec-40e0-86f2-4f6283b2ad59 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.053711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674723c5-c0ec-40e0-86f2-4f6283b2ad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.080820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-674723c5-c0ec-40e0-86f2-4f6283b2ad59 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:54.082038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-674723c5-c0ec-40e0-86f2-4f6283b2ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:54.164018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 31/65] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:54.190288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1c8e9-0382-4304-9ce2-059fff5e98c5 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.190887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1c8e9-0382-4304-9ce2-059fff5e98c5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.191366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1c8e9-0382-4304-9ce2-059fff5e98c5 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.194280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 35/66] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:54.198701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e552d6-a946-464c-be85-71b6e06229c4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.198996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e552d6-a946-464c-be85-71b6e06229c4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.199317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e552d6-a946-464c-be85-71b6e06229c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.225156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-01e552d6-a946-464c-be85-71b6e06229c4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:54.226372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-01e552d6-a946-464c-be85-71b6e06229c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:54.249807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:54.323045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 32/67] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:54.380605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde0252-b68a-4842-bd06-722dd9f43e9c None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.381216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde0252-b68a-4842-bd06-722dd9f43e9c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.381776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde0252-b68a-4842-bd06-722dd9f43e9c None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.383449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 36/68] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:54.389070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1977bd-1b4b-4675-900d-b3b2501cc9a9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.389604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1977bd-1b4b-4675-900d-b3b2501cc9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.390080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1977bd-1b4b-4675-900d-b3b2501cc9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.409839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2eac-3166-43cc-b3b0-4678219e9762 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.410453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2eac-3166-43cc-b3b0-4678219e9762 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.410976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2eac-3166-43cc-b3b0-4678219e9762 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.412585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 37/69] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:54.417710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303e712-39f8-4b7a-9ed8-7f29eb96ebba None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.418702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303e712-39f8-4b7a-9ed8-7f29eb96ebba None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.419156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303e712-39f8-4b7a-9ed8-7f29eb96ebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.426251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-db1977bd-1b4b-4675-900d-b3b2501cc9a9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:54.428499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-db1977bd-1b4b-4675-900d-b3b2501cc9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:54.447973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2303e712-39f8-4b7a-9ed8-7f29eb96ebba None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:54.450067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2303e712-39f8-4b7a-9ed8-7f29eb96ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:54.467942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:54.531614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 33/70] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:54.532479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1977bd-1b4b-4675-900d-b3b2501cc9a9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:54.547616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 38/71] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:24:54.547616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303e712-39f8-4b7a-9ed8-7f29eb96ebba None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:54.643050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303e712-39f8-4b7a-9ed8-7f29eb96ebba None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:54.682117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:54.682682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.683120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.683404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.687935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:54.697320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:54.703069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:54.703955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:24:54.704706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 39/72] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:24:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:54.705358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:54.707987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1977bd-1b4b-4675-900d-b3b2501cc9a9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:54.711904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:54.755231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:54.755929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.756216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.756498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.767445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:54.772634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:54.773489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:24:54.774240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 34/73] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:54.775343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:54.817280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee7922-6de4-496b-81c5-ad10db0c7382 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:54.854402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:54.855041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.855354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.855894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.866809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:54.872840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:54.873719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:24:54.874474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 40/74] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:24:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:54.879381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:54.881915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8ebff-89ca-41b9-8f26-23a410e88764 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:54.916228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:54.916850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:54.917111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:54.917390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:54.918602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:54.918910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:54.920423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:54.928446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 35/75] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:54.930041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:54.941507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:54.944451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:54.985187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c463b6-f3d5-4527-9426-1a0c45ab9260 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.019412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.020050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.020336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.020614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.021278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:55.021584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.022994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.030963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaac6ba-847e-4009-96e4-8724741c8447 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.031112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 41/76] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:55.031851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.065777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.066413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.066693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.066971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.068119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.069572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.071293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 36/77] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:55.071930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.132658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f250378-4d14-4d19-9e63-c2fe6f922513 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.153362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.156051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.168803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.169447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.169732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.170007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.177406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46605eee-541b-4f36-ad74-63be6f898b52 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.180323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:55.185759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:55.186707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:24:55.187474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 42/78] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:55.188127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.216215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.216754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.217041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.217318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.217980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:55.218293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.219708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.227806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 37/79] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:55.228610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.292019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f663768-c18e-47ae-a2a1-be6b7ec042ca None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.326157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.326800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.327089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.327382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] PATH_INFO: `/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.328565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] RBAC: Authorizing `identity:get_user(user_id=3cec9f43d2034445ba2c8aa17cc5e9b7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.330037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.330137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97d0df-fa7c-4b55-bea4-8bd87baea174 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.331656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 43/80] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:55.332403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.364549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.365189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.365476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.365758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.374453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.382966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.384462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.385412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.386154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 38/81] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:55.387470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.433208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287316b-e5a7-4dba-9837-89b2798a8974 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.467278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.467856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.468142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.468424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.469082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.470557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.486191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdacb6-7881-4278-b7a2-0b965fe58f17 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.497491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 44/82] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:24:55 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:55.498323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.524651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.525319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.525617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.525892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.526590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:55.526905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.528444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.539278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 39/83] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:55.540760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.612868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.635608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d940a8f-1618-48e3-8485-df6a5aaf6a07 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.645850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.667411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2dfe8-8681-4dd6-8339-b8c8235e766b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.679084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.680085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.680376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.680659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.683536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.683536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.685134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 45/84] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:55.685134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.713694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.714736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.716098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.717137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.798282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.799851 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:55.816715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47a847-0ddf-47db-bdeb-a287e80179b3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:55.864006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:55.864974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:55.865467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:55.865943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:55.869694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.920617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:55.921660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:24:55.923327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:55.951962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:55.953458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.039770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba295eb8-5c13-46d0-a9e1-60b7f1e3b338 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.066227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 46/86] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:24:56.066780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.076434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.077078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.077367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.077646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.078810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.080341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.082231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 41/87] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:55 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:56.083031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.114643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:56.168616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:56.194245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e978fa-3a0d-486b-b327-4648863fe32a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.194982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf356f6-b130-46ec-836b-432e9f8887cf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.232329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.232973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.233260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.233538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.234046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.234819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.235005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.235309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.235739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.237017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.238927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 42/88] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:56.239993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.311914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.313460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.343849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:56.351971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9e8aa-46fc-46a9-88a4-166d05655720 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.389583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.390576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.391200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.391822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.393174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.394828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.397097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 43/89] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:56.398063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.399072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:56.428154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 47/90] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:24:56.434214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.509664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8a1d9-a398-42e7-9394-1b6ca2582f85 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.542277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d74b0-ca4b-4fb0-a31b-7d7db8e89560 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.546678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.547553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.548105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.548579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.580564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.581187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.581750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:56.581858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.582781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.583633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=3cec9f43d2034445ba2c8aa17cc5e9b7) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:56.583982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.585755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.592215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 48/91] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/role_assignments?user.id=3cec9f43d2034445ba2c8aa17cc5e9b7&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:56.593128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.629337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.631153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.681971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:56.747438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 44/92] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:24:56.748889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.819584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:56.844976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94143c89-432a-40f5-9c67-a2c0a90ada74 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.864902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a7f43-b671-4d4f-b182-9e5d232b34e3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:56.901581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.902725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.903209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.903708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.904645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=bcebeadc3f6a4531a15d8d448d340f79) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:56.905348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.908121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.919677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 49/93] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/role_assignments?user.id=bcebeadc3f6a4531a15d8d448d340f79&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=6491db22b7294223a5a590b58c543f4c => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:56.921560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:56.923241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:56.924973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:56.927288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:56.927848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:56.929436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:56.932382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:56.935118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 45/94] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:56.941645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:57.078242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107ba5-923a-4e04-a3ed-ae1b81c4269f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:57.116378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:57.122505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3383b7-a86e-486f-a4a6-dbde61267eb2 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:57.130281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:57.130972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:57.131268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:57.131554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:57.132360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] RBAC: Adding query filter params (role.id=916c024b775b4858ba18c731196163a6, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=bcebeadc3f6a4531a15d8d448d340f79) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:57.132681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:57.134184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:57.134696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:57.147740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 46/95] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/role_assignments?user.id=bcebeadc3f6a4531a15d8d448d340f79&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=916c024b775b4858ba18c731196163a6 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:57.218687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f5d59-e737-49e5-be8b-53bc110e3805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:57.219285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f5d59-e737-49e5-be8b-53bc110e3805 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:57.219575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f5d59-e737-49e5-be8b-53bc110e3805 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:57.219890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f5d59-e737-49e5-be8b-53bc110e3805 None admin] PATH_INFO: `/v3/projects/8d954f89005c499c94c9f035c8fc01fa` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:57.224622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f5d59-e737-49e5-be8b-53bc110e3805 None admin] RBAC: Authorizing `identity:get_project(project_id=8d954f89005c499c94c9f035c8fc01fa)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:57.226201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f5d59-e737-49e5-be8b-53bc110e3805 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:57.228273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 50/96] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:24:56 2022] GET /identity/v3/projects/8d954f89005c499c94c9f035c8fc01fa => generated 312 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:57.234363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:57.379323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca845dd-77b9-4a75-9478-5fdbddc81fa4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:57.433882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee365b1e-b5bb-45e5-a40c-01505b413ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:57.434518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee365b1e-b5bb-45e5-a40c-01505b413ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:57.434812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee365b1e-b5bb-45e5-a40c-01505b413ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:57.435096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee365b1e-b5bb-45e5-a40c-01505b413ac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:57.435872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee365b1e-b5bb-45e5-a40c-01505b413ac8 None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=8d954f89005c499c94c9f035c8fc01fa, user.id=bcebeadc3f6a4531a15d8d448d340f79) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:57.436191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee365b1e-b5bb-45e5-a40c-01505b413ac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:57.437668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee365b1e-b5bb-45e5-a40c-01505b413ac8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:57.446513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 47/97] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:24:57 2022] GET /identity/v3/role_assignments?user.id=bcebeadc3f6a4531a15d8d448d340f79&scope.project.id=8d954f89005c499c94c9f035c8fc01fa&role.id=6491db22b7294223a5a590b58c543f4c => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:57.762516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51528b11-4092-4aed-aa39-71c2cd3e38c2 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:57.762917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51528b11-4092-4aed-aa39-71c2cd3e38c2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:57.763131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51528b11-4092-4aed-aa39-71c2cd3e38c2 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:57.764725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 51/98] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:57.771965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fc526-f794-4baf-9e75-30d832bd3449 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:57.772262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fc526-f794-4baf-9e75-30d832bd3449 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:57.772546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fc526-f794-4baf-9e75-30d832bd3449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:57.793915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-af8fc526-f794-4baf-9e75-30d832bd3449 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:57.795142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-af8fc526-f794-4baf-9e75-30d832bd3449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:57.865676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:57.886241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:24:57.963740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8feb07-afa0-4fa5-9640-c1d4ce9d9b52 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:57.964054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8feb07-afa0-4fa5-9640-c1d4ce9d9b52 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:57.964317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8feb07-afa0-4fa5-9640-c1d4ce9d9b52 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:57.966426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 52/100] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:57.971797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f801-9025-4192-b21d-3a71547c43bd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:57.972238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f801-9025-4192-b21d-3a71547c43bd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:57.972404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f801-9025-4192-b21d-3a71547c43bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:57.996727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3348f801-9025-4192-b21d-3a71547c43bd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:57.998174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3348f801-9025-4192-b21d-3a71547c43bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:58.096739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 49/101] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:58.330986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8feb07-afa0-4fa5-9640-c1d4ce9d9b52 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:58.448634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8feb07-afa0-4fa5-9640-c1d4ce9d9b52 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:58.487858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:58.488508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:58.488795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:58.489077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:58.508423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:24:58.513862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:24:58.514762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:24:58.515522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 53/102] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:24:58.521007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f801-9025-4192-b21d-3a71547c43bd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:58.579730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:58.649651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:58.653238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f801-9025-4192-b21d-3a71547c43bd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:58.690561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:58.726165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:58.726722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:58.727016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:58.727301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:58.728025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:58.728338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:58.730069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:58.751770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 50/103] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:24:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:58.757469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:58.821547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee087e0c-2180-4cbc-8dd6-538e12f89233 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:58.919582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:58.920262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:58.920551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:58.920832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:58.923186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:58.924705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:58.926299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 54/104] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:58.934361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:58.969834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7dc01-748b-431b-9942-7f3541c7a946 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:59.038200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:59.038979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:59.039170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:59.039422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] PATH_INFO: `/v3/users/7f52b14e89c54e648cdc4739c554523b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:59.055502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=7f52b14e89c54e648cdc4739c554523b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:59.057031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:59.059491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 51/105] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:24:58 2022] GET /identity/v3/users/7f52b14e89c54e648cdc4739c554523b => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:24:59.068534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:59.114607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:59.118251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcf7be-95a4-42f8-8636-9e3e3244b4e2 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:59.157682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:59.186077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10400fc2-a202-4505-be49-ad6a7a829fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:59.186729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10400fc2-a202-4505-be49-ad6a7a829fef None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:59.187018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10400fc2-a202-4505-be49-ad6a7a829fef None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:59.187302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10400fc2-a202-4505-be49-ad6a7a829fef None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:59.188031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10400fc2-a202-4505-be49-ad6a7a829fef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:59.189579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10400fc2-a202-4505-be49-ad6a7a829fef None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:59.245676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 55/106] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:24:58 2022] POST /identity/v3/projects => generated 302 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:24:59.248103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8833-e7b1-445a-8726-163afec344f4 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:59.248616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8833-e7b1-445a-8726-163afec344f4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:59.249123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff8833-e7b1-445a-8726-163afec344f4 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:59.251169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 56/107] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:24:59.256527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3214-aecf-4b50-8859-9868de8ac7f2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:59.258375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ded4-6057-40a9-a28f-d27741bd2f60 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:59.258938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ded4-6057-40a9-a28f-d27741bd2f60 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:59.259417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ded4-6057-40a9-a28f-d27741bd2f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:59.297137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-9b40ded4-6057-40a9-a28f-d27741bd2f60 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:24:59.298745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9b40ded4-6057-40a9-a28f-d27741bd2f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:24:59.311086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:59.311754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:59.312051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:59.312338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:59.456860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:59.458368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:59.472816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 57/108] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:24:59.505328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:59.569730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 52/109] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:24:59.580765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ded4-6057-40a9-a28f-d27741bd2f60 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:59.706540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:24:59.734247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ded4-6057-40a9-a28f-d27741bd2f60 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:59.781280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:59.782278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:59.782760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:59.783259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:59.785107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:59.786786 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:59.788650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 58/110] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:24:59 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:24:59.795043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:59.923990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7ef7-bd2f-4f35-bccb-c3de961e250d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:24:59.939215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:24:59.967421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:24:59.968088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:24:59.968534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:24:59.968825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:24:59.969576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] RBAC: Adding query filter params (role.id=c40981e1b3ca4fcbaeba6a24898fc8b2, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=7f52b14e89c54e648cdc4739c554523b) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:24:59.969895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:24:59.971361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:24:59.977588 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 53/111] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:24:59 2022] GET /identity/v3/role_assignments?user.id=7f52b14e89c54e648cdc4739c554523b&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:00.148086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18772b4-6cd2-42cd-8a85-318fab39b9c9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:00.201763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce816b56-4afd-46ea-b4c4-812386a90f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:00.202358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce816b56-4afd-46ea-b4c4-812386a90f69 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.202650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce816b56-4afd-46ea-b4c4-812386a90f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.202936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce816b56-4afd-46ea-b4c4-812386a90f69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.216343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce816b56-4afd-46ea-b4c4-812386a90f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ce816b56-4afd-46ea-b4c4-812386a90f69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:00.221344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:00.222242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:00.223016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 59/112] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:00.229496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:00.238397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:00.241007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe53a-fec0-4f6b-9c7b-452491ab6dd4 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.241300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe53a-fec0-4f6b-9c7b-452491ab6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.241592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe53a-fec0-4f6b-9c7b-452491ab6dd4 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.243187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 60/113] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:00.248969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c69ae-9f84-47d1-87a4-c35dbd4d92f4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.249262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c69ae-9f84-47d1-87a4-c35dbd4d92f4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.249553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c69ae-9f84-47d1-87a4-c35dbd4d92f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.279455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-432c69ae-9f84-47d1-87a4-c35dbd4d92f4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:00.281595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-432c69ae-9f84-47d1-87a4-c35dbd4d92f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:00.293161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:00.403406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 61/114] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:00.405100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62ab7-fbc5-40cb-957d-80c9fe96ec09 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.405398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62ab7-fbc5-40cb-957d-80c9fe96ec09 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.405686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e62ab7-fbc5-40cb-957d-80c9fe96ec09 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.407883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 62/115] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:00.408814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415217b-d8ea-4e18-a1fc-0e48275baed1 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.409107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415217b-d8ea-4e18-a1fc-0e48275baed1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.413446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415217b-d8ea-4e18-a1fc-0e48275baed1 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.414366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ba01-51b4-4d10-9ec6-b8e10ed62af6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:00.414850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 63/116] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:00.416083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ed6a-ee59-4a60-a0f0-a5139c398c3f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.416719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ed6a-ee59-4a60-a0f0-a5139c398c3f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.416719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ed6a-ee59-4a60-a0f0-a5139c398c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.450718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0e33ed6a-ee59-4a60-a0f0-a5139c398c3f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:00.452362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0e33ed6a-ee59-4a60-a0f0-a5139c398c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:00.458905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f73df9-5588-48d9-a0c7-0e7641e58894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:00.458905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f73df9-5588-48d9-a0c7-0e7641e58894 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.458905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f73df9-5588-48d9-a0c7-0e7641e58894 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.458905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f73df9-5588-48d9-a0c7-0e7641e58894 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.459226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f73df9-5588-48d9-a0c7-0e7641e58894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:00.459226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f73df9-5588-48d9-a0c7-0e7641e58894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:00.460601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f73df9-5588-48d9-a0c7-0e7641e58894 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:00.479825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 54/117] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:00.482770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6852-7527-4e05-b0b0-340d25f36df5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.483065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6852-7527-4e05-b0b0-340d25f36df5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.483348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6852-7527-4e05-b0b0-340d25f36df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.520317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-802f6852-7527-4e05-b0b0-340d25f36df5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:00.521526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-802f6852-7527-4e05-b0b0-340d25f36df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:00.586474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 64/118] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:00.588042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33ed6a-ee59-4a60-a0f0-a5139c398c3f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:00.607666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:00.617240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 55/119] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:00.684703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:00.718824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33ed6a-ee59-4a60-a0f0-a5139c398c3f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:00.755055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:00.756032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.756521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.757020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] PATH_INFO: `/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.758368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] RBAC: Authorizing `identity:get_user(user_id=3cec9f43d2034445ba2c8aa17cc5e9b7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:00.760081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:00.762091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 65/120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:00 2022] GET /identity/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:00.767785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f6852-7527-4e05-b0b0-340d25f36df5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:00.899666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f6852-7527-4e05-b0b0-340d25f36df5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:00.910908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:00.940648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:00.941663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:00.942194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:00.942697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:00.944068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:00.945722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:00.947609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 56/121] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:00 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:00.956579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.061605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:01.126069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998716-6999-4a41-8395-48ee76e827ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.165797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2819c49-f8d1-4a38-a7e2-16f7db634612 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.191419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.192171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.192462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.192750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/3cec9f43d2034445ba2c8aa17cc5e9b7/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.194687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=275ef91a40de4500ace5dd380f4f1ffe, user_id=3cec9f43d2034445ba2c8aa17cc5e9b7, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:01.196177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:01.211894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 57/122] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:00 2022] PUT /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/3cec9f43d2034445ba2c8aa17cc5e9b7/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:01.212526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.218187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.219092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.219559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.220264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.232298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:01.236455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:01.241693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:01.242769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:01.243712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:01.252092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 66/123] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:01.252092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.353489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d70de-cdc4-4d5a-9b05-d72861f969f0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.363557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0d38d-3918-4a3e-8373-0c6ab3ede356 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.383131 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:01.399157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.400106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.400755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.401391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.402235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.402990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.403377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.403789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.415805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:01.417092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:01.421155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:01.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:01.423107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:01.428314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:01.430080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:01.431949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:01.432957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 67/124] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:01.433182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.435919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 58/125] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:01.436954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.506520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:01.556049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c80a1-3e13-4222-b035-097824abcb5c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.579342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d1907-ff87-4047-b84f-6c1d9f61a06e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.609552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.610098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.610386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.610668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.611355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:01.611694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:01.613102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:01.623623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.624530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 68/126] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:01.624694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.624694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.625035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.625276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.625864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:01.626242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:01.627792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:01.637776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 59/127] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:01.638568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.690529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:01.748924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35467-4a5d-416f-bb4d-240d6a15de5d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.783969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.784618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.784906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.785184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.786392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:01.787902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:01.789676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 60/128] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:01.790288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.896113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b188cc-8c22-4a5d-b9cb-5d5b78935ff2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.905605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91378fef-240f-43d3-87d3-5c801f4d3c83 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:01.921780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:01.932090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:01.932742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:01.933035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:01.933371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:01.934524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:01.936252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:01.937858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 61/129] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:01.938646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:01.971954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:02.033707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.034777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.035363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.035888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.036772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:02.037285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.039099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.045019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869feb-6a0f-41f4-84c6-7fe4223a83a3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:02.055825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 69/130] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:02.057090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:02.086465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.086465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.086465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.086465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.086867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.087569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.094924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 62/131] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:01 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:02.094924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:02.143754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:02.252341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b8ff-6b03-46eb-a4bd-4aa7f2365061 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:02.260944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac62a2-ec1f-4d4b-8f57-ef61ad40715d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:02.291935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.293665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.294159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.294661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.296495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.297963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.303899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 63/132] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:02 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:02.303899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:02.305253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5574ae7-4b1f-4b17-8ac3-08eba23e760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.305900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574ae7-4b1f-4b17-8ac3-08eba23e760a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.306245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574ae7-4b1f-4b17-8ac3-08eba23e760a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.306796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5574ae7-4b1f-4b17-8ac3-08eba23e760a None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.312378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5574ae7-4b1f-4b17-8ac3-08eba23e760a None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.313862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5574ae7-4b1f-4b17-8ac3-08eba23e760a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.316305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 70/133] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:02 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:02.318508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfab84-1faf-42ab-8808-ede1d6709f7e None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.319014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfab84-1faf-42ab-8808-ede1d6709f7e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.319483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfab84-1faf-42ab-8808-ede1d6709f7e None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.320928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 71/134] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:02.323172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfab84-1faf-42ab-8808-ede1d6709f7e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:02.396176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:02.439969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabc76-366a-445b-946e-129d550deed1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:02.441871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfab84-1faf-42ab-8808-ede1d6709f7e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:02.456392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:02.474987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed3fc3-76ee-44da-b207-678a60271263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.475675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed3fc3-76ee-44da-b207-678a60271263 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.475961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed3fc3-76ee-44da-b207-678a60271263 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.476235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed3fc3-76ee-44da-b207-678a60271263 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/bcebeadc3f6a4531a15d8d448d340f79/roles/916c024b775b4858ba18c731196163a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.478381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed3fc3-76ee-44da-b207-678a60271263 None admin] RBAC: Authorizing `identity:create_grant(project_id=275ef91a40de4500ace5dd380f4f1ffe, user_id=bcebeadc3f6a4531a15d8d448d340f79, role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.479888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed3fc3-76ee-44da-b207-678a60271263 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.481541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.482333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.482796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.483080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] PATH_INFO: `/v3/projects/8d954f89005c499c94c9f035c8fc01fa` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.484325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] RBAC: Authorizing `identity:get_project(project_id=8d954f89005c499c94c9f035c8fc01fa)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.485748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.492438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 72/135] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:02 2022] GET /identity/v3/projects/8d954f89005c499c94c9f035c8fc01fa => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:02.492438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:02.500178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 64/136] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:02 2022] PUT /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/bcebeadc3f6a4531a15d8d448d340f79/roles/916c024b775b4858ba18c731196163a6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:02.501596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8e88-f821-47c3-857e-704fd9f726d8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.501886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8e88-f821-47c3-857e-704fd9f726d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.502166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8e88-f821-47c3-857e-704fd9f726d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.537047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-398d8e88-f821-47c3-857e-704fd9f726d8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:02.538444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-398d8e88-f821-47c3-857e-704fd9f726d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:02.616541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 65/137] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:02.617918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7ff9-ccb6-4dcd-8b6a-d6386d88396f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.618209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7ff9-ccb6-4dcd-8b6a-d6386d88396f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.618538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7ff9-ccb6-4dcd-8b6a-d6386d88396f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.624472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 66/138] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:02.624472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7ff9-ccb6-4dcd-8b6a-d6386d88396f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:02.641093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0d6e9-522c-4e3b-81b2-13ee8babb5a8 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:02.673344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:02.697382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a9c43-7a68-48be-9fa9-aace27ddbab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.698176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9c43-7a68-48be-9fa9-aace27ddbab2 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.698466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9c43-7a68-48be-9fa9-aace27ddbab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.699031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a9c43-7a68-48be-9fa9-aace27ddbab2 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/bcebeadc3f6a4531a15d8d448d340f79/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.700883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a9c43-7a68-48be-9fa9-aace27ddbab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=275ef91a40de4500ace5dd380f4f1ffe, user_id=bcebeadc3f6a4531a15d8d448d340f79, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.702365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a9c43-7a68-48be-9fa9-aace27ddbab2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.722258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 73/139] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:02 2022] PUT /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/bcebeadc3f6a4531a15d8d448d340f79/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:02.725885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1524e6-06d7-43f8-8897-50c3972de4ff None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.726183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1524e6-06d7-43f8-8897-50c3972de4ff None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.726472 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1524e6-06d7-43f8-8897-50c3972de4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.765696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7ff9-ccb6-4dcd-8b6a-d6386d88396f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:02.772862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ad1524e6-06d7-43f8-8897-50c3972de4ff None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:02.774113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ad1524e6-06d7-43f8-8897-50c3972de4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:02.776001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:02.821796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:02.822413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:02.822739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:02.823023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] PATH_INFO: `/v3/projects/8d954f89005c499c94c9f035c8fc01fa/users/bcebeadc3f6a4531a15d8d448d340f79/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:02.828198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d954f89005c499c94c9f035c8fc01fa, user_id=bcebeadc3f6a4531a15d8d448d340f79, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:02.831177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:02.855096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 67/140] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:02 2022] PUT /identity/v3/projects/8d954f89005c499c94c9f035c8fc01fa/users/bcebeadc3f6a4531a15d8d448d340f79/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:02.907637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 74/141] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:03.003385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:03.139834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a1fe-6edd-4de0-bbf4-d777fc8538f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:03.175836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:03.176487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:03.176767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:03.177096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:03.178191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:03.179695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:03.181592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 68/142] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:03.187826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1524e6-06d7-43f8-8897-50c3972de4ff None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:03.252940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:03.311833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:03.327155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1524e6-06d7-43f8-8897-50c3972de4ff None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:03.345958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:03.384023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:03.384968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:03.385446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:03.385913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:03.387365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:03.389054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:03.414628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 75/143] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:03 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:03.464118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03027f8b-d003-491f-9120-2356c875ce4b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:03.502177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:03.502883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:03.503174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:03.503451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:03.515646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:03.520836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:03.521708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:03.522556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 69/144] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:03.528480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:03.659968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13a0d-2981-47ea-b7a2-389adcd54833 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:03.695298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:03.695954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:03.696251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:03.696531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:03.697211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:03.697520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:03.698958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:03.708441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 76/145] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:03.714086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:03.830014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:03.836891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80cc09-9de4-46b5-a4f8-bf811736bde2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:03.882150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:03.882792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:03.883079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:03.883360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] PATH_INFO: `/v3/users/7f52b14e89c54e648cdc4739c554523b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:03.886293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=7f52b14e89c54e648cdc4739c554523b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:03.887989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:03.889888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 70/146] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:03 2022] GET /identity/v3/users/7f52b14e89c54e648cdc4739c554523b => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:03.895306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:03.926978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:04.014624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998517dd-8258-49da-a982-89680ca28f82 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:04.054991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721d0db-1b02-4c86-9064-28f80299c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:04.055655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721d0db-1b02-4c86-9064-28f80299c622 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:04.055949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721d0db-1b02-4c86-9064-28f80299c622 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:04.056233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721d0db-1b02-4c86-9064-28f80299c622 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:04.057379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721d0db-1b02-4c86-9064-28f80299c622 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:04.058997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721d0db-1b02-4c86-9064-28f80299c622 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:04.060681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 77/147] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:03 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:04.066570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:04.196624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778265a-bc1c-4ab4-ace5-9cce63092ee7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:04.221597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad36837-9155-47f5-ae7f-e8956beaee7a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:04.221911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad36837-9155-47f5-ae7f-e8956beaee7a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:04.222167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad36837-9155-47f5-ae7f-e8956beaee7a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:04.223804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 78/148] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:04.232098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b744f8-2f03-41f1-a5a5-b9eb7a5a67d9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:04.232384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b744f8-2f03-41f1-a5a5-b9eb7a5a67d9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:04.232663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b744f8-2f03-41f1-a5a5-b9eb7a5a67d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:04.243124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:04.244254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:04.244746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:04.245491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/7f52b14e89c54e648cdc4739c554523b/roles/c40981e1b3ca4fcbaeba6a24898fc8b2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:04.247884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=275ef91a40de4500ace5dd380f4f1ffe, user_id=7f52b14e89c54e648cdc4739c554523b, role_id=c40981e1b3ca4fcbaeba6a24898fc8b2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:04.249554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:04.264664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-08b744f8-2f03-41f1-a5a5-b9eb7a5a67d9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:04.266028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-08b744f8-2f03-41f1-a5a5-b9eb7a5a67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:04.272335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 71/149] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:04 2022] PUT /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/users/7f52b14e89c54e648cdc4739c554523b/roles/c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:04.360364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 79/150] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:04.804092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:04.838644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:04.944595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4cfb8-ae7f-4b9b-b2b0-7dd3a98c21d4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:04.986714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:04.987713 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:04.988159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:04.988579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.005203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:05.010849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:05.012657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:05.013513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:05.019688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 72/151] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:05.021702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b744f8-2f03-41f1-a5a5-b9eb7a5a67d9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:05.051225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:05.135114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b744f8-2f03-41f1-a5a5-b9eb7a5a67d9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:05.174528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be7df-7987-40be-9263-1543d9835920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:05.175156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be7df-7987-40be-9263-1543d9835920 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:05.175441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be7df-7987-40be-9263-1543d9835920 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:05.175788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be7df-7987-40be-9263-1543d9835920 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.176474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362be7df-7987-40be-9263-1543d9835920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:05.176883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362be7df-7987-40be-9263-1543d9835920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:05.178193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362be7df-7987-40be-9263-1543d9835920 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:05.188877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 80/152] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:05.193529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:05.306571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:05.329160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1789bfc-9256-48ad-a655-06c825e43042 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:05.374716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d6d38-10d3-4e9c-9056-915300b3c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:05.375416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d6d38-10d3-4e9c-9056-915300b3c0ed None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:05.375664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d6d38-10d3-4e9c-9056-915300b3c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:05.375946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d6d38-10d3-4e9c-9056-915300b3c0ed None admin] PATH_INFO: `/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.377179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d6d38-10d3-4e9c-9056-915300b3c0ed None admin] RBAC: Authorizing `identity:get_user(user_id=3cec9f43d2034445ba2c8aa17cc5e9b7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:05.378647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d6d38-10d3-4e9c-9056-915300b3c0ed None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:05.380451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 73/153] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:05 2022] GET /identity/v3/users/3cec9f43d2034445ba2c8aa17cc5e9b7 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:05.386185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be7df-7987-40be-9263-1543d9835920 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:05.399208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc37f0-ac02-4c36-9a15-f08a19d386bd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:05.399500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc37f0-ac02-4c36-9a15-f08a19d386bd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:05.399806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc37f0-ac02-4c36-9a15-f08a19d386bd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.402938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 74/154] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:05.413237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37e13-d865-4e70-9bea-c4fdf608a3d3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:05.413718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37e13-d865-4e70-9bea-c4fdf608a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:05.414140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37e13-d865-4e70-9bea-c4fdf608a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.444637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4ab37e13-d865-4e70-9bea-c4fdf608a3d3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:05.446151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4ab37e13-d865-4e70-9bea-c4fdf608a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:05.531996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:05.549784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be7df-7987-40be-9263-1543d9835920 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:05.604324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53cb88-084c-477d-9068-c21c35316c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:05.604963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53cb88-084c-477d-9068-c21c35316c15 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:05.605795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53cb88-084c-477d-9068-c21c35316c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:05.606073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53cb88-084c-477d-9068-c21c35316c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.612939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 75/155] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:05.693946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53cb88-084c-477d-9068-c21c35316c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:05.695363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53cb88-084c-477d-9068-c21c35316c15 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:05.798335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:05.805759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 81/156] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:05.809288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab37e13-d865-4e70-9bea-c4fdf608a3d3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:05.849428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f3ef-0dcd-4aa2-84f3-c3ee3b23b018 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:05.849756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f3ef-0dcd-4aa2-84f3-c3ee3b23b018 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:05.849990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f3ef-0dcd-4aa2-84f3-c3ee3b23b018 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.851410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 82/157] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:25:05.856999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d1d9-276a-4dc7-94bc-b3cd13b84281 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:05.857286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d1d9-276a-4dc7-94bc-b3cd13b84281 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:05.857569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d1d9-276a-4dc7-94bc-b3cd13b84281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:05.886480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ea00d1d9-276a-4dc7-94bc-b3cd13b84281 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:05.888498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ea00d1d9-276a-4dc7-94bc-b3cd13b84281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:05.952694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:05.990298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab37e13-d865-4e70-9bea-c4fdf608a3d3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:06.022206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 83/158] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:06.023143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d1d9-276a-4dc7-94bc-b3cd13b84281 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:06.080343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:06.081687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.081980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.082412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.083494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:06.090163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:06.092340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 76/159] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:05 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:06.098372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:06.134032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d1d9-276a-4dc7-94bc-b3cd13b84281 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:06.153555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:06.174782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:06.175727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.176185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.176606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.188273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:06.194768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:06.195903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:06.196931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:06.199901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 84/160] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:06.207336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:06.327508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f38778-cea6-4ec3-8fe2-4a38d75ea8ff None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:06.368617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:06.369525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.369974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.370935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.371941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:06.372397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:06.374296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:06.383993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 85/161] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:06.385778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28efe9-60be-4bdf-9779-25a33a833e55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:06.394380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:06.441173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:06.488399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:06.488945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.489232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.489512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.490266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=3cec9f43d2034445ba2c8aa17cc5e9b7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:06.490583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:06.492221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:06.513609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 77/162] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:06 2022] GET /identity/v3/role_assignments?user.id=3cec9f43d2034445ba2c8aa17cc5e9b7&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:06.518709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d8346-14e7-4ab6-bf01-97260d405a55 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:06.558048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:06.559666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.560368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.560843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.562345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:06.564089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:06.565984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 86/163] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:06 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:06.572697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:06.601894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:06.718481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2957a-ec53-4120-b8ce-7a30d365af9d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:06.745641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:06.776392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4c938-9929-4567-aad4-e3265ba47cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:06.777073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4c938-9929-4567-aad4-e3265ba47cbc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.777359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4c938-9929-4567-aad4-e3265ba47cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.778032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4c938-9929-4567-aad4-e3265ba47cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.899508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915be5c2-f122-4021-b754-949709fe36b1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:06.912016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:06.941235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca22e1-cc31-4abb-90c1-4c2192f15038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:06.942199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca22e1-cc31-4abb-90c1-4c2192f15038 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.943150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca22e1-cc31-4abb-90c1-4c2192f15038 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.943641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca22e1-cc31-4abb-90c1-4c2192f15038 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.956997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca22e1-cc31-4abb-90c1-4c2192f15038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-06ca22e1-cc31-4abb-90c1-4c2192f15038 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:06.962400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:06.963298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:06.964130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:06.967161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 87/164] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:06.968774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2d44-33c6-4f77-b70e-c6a83780173e None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:06.969751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2d44-33c6-4f77-b70e-c6a83780173e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:06.970235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2d44-33c6-4f77-b70e-c6a83780173e None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:06.972792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 88/165] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:06.973806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2d44-33c6-4f77-b70e-c6a83780173e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:06.989617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4c938-9929-4567-aad4-e3265ba47cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:06.990995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4c938-9929-4567-aad4-e3265ba47cbc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:07.011947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:07.097219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2d44-33c6-4f77-b70e-c6a83780173e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:07.169982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:07.170604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:07.170886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:07.171164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:07.171870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:07.172177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:07.175080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:07.188832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 78/166] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:07.190240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d789f9-412e-4d36-a4dc-c36c11dab82a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:07.190537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d789f9-412e-4d36-a4dc-c36c11dab82a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:07.190817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d789f9-412e-4d36-a4dc-c36c11dab82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:07.196723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 89/167] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:07.198852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:07.230964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-41d789f9-412e-4d36-a4dc-c36c11dab82a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:07.234968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41d789f9-412e-4d36-a4dc-c36c11dab82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:07.259796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:07.381283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 79/168] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:07.383463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d789f9-412e-4d36-a4dc-c36c11dab82a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:07.393124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166c29-571c-41e8-bed0-cb3fffdec08b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:07.468723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:07.475138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:07.475847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:07.476135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:07.476415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:07.477577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:07.479059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:07.481904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 90/169] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:07 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:07.487721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:07.571472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d789f9-412e-4d36-a4dc-c36c11dab82a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:07.588380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:07.594802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b2d15-8530-4ab4-93e0-276ba1934efe None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:07.631126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:07.632008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:07.632430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:07.632814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:07.633676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] RBAC: Adding query filter params (role.id=916c024b775b4858ba18c731196163a6, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=bcebeadc3f6a4531a15d8d448d340f79) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:07.634071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:07.635750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:07.638559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:07.639513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:07.639958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:07.640395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:07.641712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:07.645598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 91/170] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:07 2022] GET /identity/v3/role_assignments?user.id=bcebeadc3f6a4531a15d8d448d340f79&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=916c024b775b4858ba18c731196163a6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:07.646611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:07.648599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 80/171] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:07 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:07.655214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:07.796484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8d72-021f-47ba-befd-6ccde17e4551 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:07.836821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d3a15-7263-4769-821f-402f181e06f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:07.837457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3a15-7263-4769-821f-402f181e06f2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:07.837741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3a15-7263-4769-821f-402f181e06f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:07.838018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3a15-7263-4769-821f-402f181e06f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:07.850648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:07.869860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:07.933858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d3a15-7263-4769-821f-402f181e06f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:07.935292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d3a15-7263-4769-821f-402f181e06f2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:08.070319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c8d39-d8f3-4f9f-b3a9-3e49a9985cc2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:08.103994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:08.113408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 92/172] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:08.115297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa6d46-7ae4-4f5a-bdfc-1d7c2285d7c5 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.115824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa6d46-7ae4-4f5a-bdfc-1d7c2285d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.116301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa6d46-7ae4-4f5a-bdfc-1d7c2285d7c5 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.117932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 93/173] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:08.125535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dded33-62e3-4d0c-bb4a-2976f19ac682 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.125743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dded33-62e3-4d0c-bb4a-2976f19ac682 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.125931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dded33-62e3-4d0c-bb4a-2976f19ac682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.149632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-23dded33-62e3-4d0c-bb4a-2976f19ac682 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:08.150851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-23dded33-62e3-4d0c-bb4a-2976f19ac682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:08.176871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:08.177539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.177827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.178108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.212636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:08.218642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:08.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:08.220853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:08.221569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:08.223119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 81/174] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:08.226349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:08.242350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 94/175] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:08.244100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dded33-62e3-4d0c-bb4a-2976f19ac682 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:08.382559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dded33-62e3-4d0c-bb4a-2976f19ac682 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:08.425547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77e7b-6d16-40b4-861f-ed821f29245b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:08.439324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183a10e-d687-49b0-a504-4292d12cec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:08.440078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a10e-d687-49b0-a504-4292d12cec97 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.440434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a10e-d687-49b0-a504-4292d12cec97 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.440812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a10e-d687-49b0-a504-4292d12cec97 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.441554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183a10e-d687-49b0-a504-4292d12cec97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:08.441927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183a10e-d687-49b0-a504-4292d12cec97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:08.443410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183a10e-d687-49b0-a504-4292d12cec97 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:08.458132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 95/176] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:08.459476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171269d-defe-4058-8485-1d544bcd8b96 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.459857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171269d-defe-4058-8485-1d544bcd8b96 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.460211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171269d-defe-4058-8485-1d544bcd8b96 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.461500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 96/177] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:08.467432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:08.467626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d618b0-e4d9-41eb-b194-36662103ffe2 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.467711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d618b0-e4d9-41eb-b194-36662103ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.468131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d618b0-e4d9-41eb-b194-36662103ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.468742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.469201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.469700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.471144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:08.472921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:08.474755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 82/178] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:08 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:08.475964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:08.498763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-06d618b0-e4d9-41eb-b194-36662103ffe2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:08.501796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-06d618b0-e4d9-41eb-b194-36662103ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:08.532773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:08.589217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:08.607559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af974c-9ace-4330-ab7f-2ac259f51134 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:08.613150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 97/179] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:08.613977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d618b0-e4d9-41eb-b194-36662103ffe2 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:08.651081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043fa3c-543b-46cc-967f-5fa90008df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:08.652617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fa3c-543b-46cc-967f-5fa90008df85 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.653086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fa3c-543b-46cc-967f-5fa90008df85 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.653571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043fa3c-543b-46cc-967f-5fa90008df85 None admin] PATH_INFO: `/v3/users/bcebeadc3f6a4531a15d8d448d340f79` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.655016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043fa3c-543b-46cc-967f-5fa90008df85 None admin] RBAC: Authorizing `identity:get_user(user_id=bcebeadc3f6a4531a15d8d448d340f79)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:08.656791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043fa3c-543b-46cc-967f-5fa90008df85 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:08.658568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 83/180] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:08 2022] GET /identity/v3/users/bcebeadc3f6a4531a15d8d448d340f79 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:08.660042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebce2e-a40f-4e38-a62c-433182cf5ce0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.660531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebce2e-a40f-4e38-a62c-433182cf5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.660995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebce2e-a40f-4e38-a62c-433182cf5ce0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.662372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 84/181] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:08.663756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebce2e-a40f-4e38-a62c-433182cf5ce0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:08.732856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d618b0-e4d9-41eb-b194-36662103ffe2 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:08.770421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:08.771041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.771324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.771692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.772379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=bcebeadc3f6a4531a15d8d448d340f79) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:08.772692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:08.774523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:08.778512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebce2e-a40f-4e38-a62c-433182cf5ce0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:08.788042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 98/182] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:08 2022] GET /identity/v3/role_assignments?user.id=bcebeadc3f6a4531a15d8d448d340f79&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=6491db22b7294223a5a590b58c543f4c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:08.789091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:08.789616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:08.818818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b2587-f5ff-4f01-b795-c1b837384757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:08.819885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b2587-f5ff-4f01-b795-c1b837384757 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.820366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b2587-f5ff-4f01-b795-c1b837384757 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.820879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b2587-f5ff-4f01-b795-c1b837384757 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.832644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b2587-f5ff-4f01-b795-c1b837384757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-499b2587-f5ff-4f01-b795-c1b837384757 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:08.838077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:08.839049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:08.840625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:08.842886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 85/183] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:08.844473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feb77b-1be7-4689-9170-62899e3d5529 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:08.844905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feb77b-1be7-4689-9170-62899e3d5529 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:08.845353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feb77b-1be7-4689-9170-62899e3d5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:08.887025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:08.888733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-11feb77b-1be7-4689-9170-62899e3d5529 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:08.889992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11feb77b-1be7-4689-9170-62899e3d5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:08.968767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3683d4-bb2c-434e-bc65-9af5e3fab270 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:08.988843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 86/184] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:08.990064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feb77b-1be7-4689-9170-62899e3d5529 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.016736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892ea0e-c2f8-4d87-81e7-748a7b6980f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.017359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ea0e-c2f8-4d87-81e7-748a7b6980f4 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.017637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ea0e-c2f8-4d87-81e7-748a7b6980f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.017911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ea0e-c2f8-4d87-81e7-748a7b6980f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.111097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.113240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892ea0e-c2f8-4d87-81e7-748a7b6980f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.115443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892ea0e-c2f8-4d87-81e7-748a7b6980f4 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.119062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feb77b-1be7-4689-9170-62899e3d5529 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.160160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.160781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.161065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.161340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.162008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:09.162314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.163963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.173884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 87/185] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:09.174897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.176864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.234419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 99/186] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:09.236918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517815e-2fb3-4e35-87d8-6a4f77c26891 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.237205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517815e-2fb3-4e35-87d8-6a4f77c26891 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.237482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517815e-2fb3-4e35-87d8-6a4f77c26891 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.239496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 100/187] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:09.240181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517815e-2fb3-4e35-87d8-6a4f77c26891 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.286468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c0224-4924-404a-b819-4cdda9b13176 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.321212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070767-db3d-41ea-9311-678539991492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.321834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070767-db3d-41ea-9311-678539991492 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.322121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070767-db3d-41ea-9311-678539991492 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.322392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070767-db3d-41ea-9311-678539991492 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.332875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070767-db3d-41ea-9311-678539991492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0c070767-db3d-41ea-9311-678539991492 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:09.338138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:09.339261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 88/188] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:09.341217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070767-db3d-41ea-9311-678539991492 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.347243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517815e-2fb3-4e35-87d8-6a4f77c26891 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.361376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.381785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d0ec-38a0-4f45-bead-d8b7a7275d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.382551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d0ec-38a0-4f45-bead-d8b7a7275d22 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.382689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d0ec-38a0-4f45-bead-d8b7a7275d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.382957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d0ec-38a0-4f45-bead-d8b7a7275d22 None admin] PATH_INFO: `/v3/users/f735a7c9699a40c9a81361577cefaaf7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.397675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d0ec-38a0-4f45-bead-d8b7a7275d22 None admin] RBAC: Authorizing `identity:get_user(user_id=f735a7c9699a40c9a81361577cefaaf7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.399141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d0ec-38a0-4f45-bead-d8b7a7275d22 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.400763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 101/189] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/users/f735a7c9699a40c9a81361577cefaaf7 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:09.400763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac1e4-35dd-4f67-b224-6eff67d0dfe0 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.400763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac1e4-35dd-4f67-b224-6eff67d0dfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.400763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac1e4-35dd-4f67-b224-6eff67d0dfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.409879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.421408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-460ac1e4-35dd-4f67-b224-6eff67d0dfe0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:09.422594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-460ac1e4-35dd-4f67-b224-6eff67d0dfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:09.444376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070767-db3d-41ea-9311-678539991492 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.477782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.478403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.478682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.478957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] PATH_INFO: `/v3/projects/8d954f89005c499c94c9f035c8fc01fa` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.480645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] RBAC: Authorizing `identity:get_project(project_id=8d954f89005c499c94c9f035c8fc01fa)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.482383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.484203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 89/190] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/projects/8d954f89005c499c94c9f035c8fc01fa => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:09.484895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.493356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 102/191] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:09.501305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ac1e4-35dd-4f67-b224-6eff67d0dfe0 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.579649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.596411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985577ae-569b-4b27-a913-993e5ca54e4c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.603047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ac1e4-35dd-4f67-b224-6eff67d0dfe0 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.632348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.632972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.633257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.633524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.638587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.639261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.639628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.639913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.640575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:09.640878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.642252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.643738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.644721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:09.650504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:09.651409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 90/192] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:09.653406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.657155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 103/193] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:09.657846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.755493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ba55-4ac4-46af-b2f8-c943ba2ef246 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.768227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19791-99ad-43b9-8c27-94c5992bd5c6 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.788578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.789190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.789493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.789769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.802532 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.803136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.803415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.803721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.804455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=8d954f89005c499c94c9f035c8fc01fa, user.id=bcebeadc3f6a4531a15d8d448d340f79) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:09.804761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.805263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.806217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.812423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 104/194] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/role_assignments?user.id=bcebeadc3f6a4531a15d8d448d340f79&scope.project.id=8d954f89005c499c94c9f035c8fc01fa&role.id=6491db22b7294223a5a590b58c543f4c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:09.813206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.867655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.869555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.884412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:09.931269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81fdf-db18-42fa-bc71-da6c99eebcf0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:09.972004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:09.972619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:09.972899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:09.973179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:09.973847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:09.974155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:09.975541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:09.987194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 105/195] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:09.988330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 91/196] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:09.988809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:09.989304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.045693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.101841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bd721-ba9e-4be0-8ab9-3a1449889080 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.102061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22eec3-ede6-4da9-a42c-af62362ded11 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.134716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.142511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.143150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.143435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.143763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.144867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.146320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.146836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.147494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.147810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.148095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] PATH_INFO: `/v3/users/7f52b14e89c54e648cdc4739c554523b` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.148284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 92/197] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:10.149115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.149226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] RBAC: Authorizing `identity:get_user(user_id=7f52b14e89c54e648cdc4739c554523b)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.150675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.152346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 106/198] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:09 2022] GET /identity/v3/users/7f52b14e89c54e648cdc4739c554523b => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:10.156947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.252024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4faa2-5008-4083-9823-ce831d0552bb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.253018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b94e2-c22a-4ca6-b83e-697990e52fbe None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.265252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.286249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.286877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.287152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.287427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] PATH_INFO: `/v3/users/f735a7c9699a40c9a81361577cefaaf7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.287985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.288556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] RBAC: Authorizing `identity:get_user(user_id=f735a7c9699a40c9a81361577cefaaf7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.288649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.288874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.289149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.289987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.290253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.296800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 93/199] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:10 2022] GET /identity/v3/users/f735a7c9699a40c9a81361577cefaaf7 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:10.296928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.297006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.297091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 107/200] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:10 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:10.297091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.353508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.390278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9c3b3-eb5f-4666-9dea-18ed6dc25636 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.395181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c6e0-179e-4190-9304-894838f5b3a1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.424865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.425466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.425744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.426016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.426660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.428129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.429206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.429810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.430091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.430368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.449986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 94/201] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:10 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:10.452471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.499714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.511104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.513032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.578109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e0208-9467-4ab6-bea8-9d5752fc0999 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.579315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.621921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.622870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.623438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.623744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.628941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 108/202] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:10.630130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.710204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.711754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.759553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3738c8-c036-43c4-af5a-eefd37a2b05a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.773032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.801589 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.802212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.802486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.802765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.803506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=f735a7c9699a40c9a81361577cefaaf7) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:10.803851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.805315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:10.813470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 109/203] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:10 2022] GET /identity/v3/role_assignments?user.id=f735a7c9699a40c9a81361577cefaaf7&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:10.814118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.849720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 95/204] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:10.851844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:10.856434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:10.951221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9257a7-40a2-4de1-8461-ffb4de06fb9c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.965752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bff90-62c8-462b-b740-c75b42d09a22 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:10.991204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:10.992240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:10.992737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:10.993205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:10.994612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:10.998616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:11.001204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 110/205] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:10 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:11.009079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:11.028017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:11.028676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:11.028961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:11.029234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:11.030461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:11.031964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:11.033643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 96/206] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:10 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:11.040765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:11.055124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:11.141406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:11.164297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1589d-726d-4c4d-b6ef-f669cdb7d847 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:11.187581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d90abd-270e-4917-90f5-c9a04ba6f442 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:11.207625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738887e-ce46-4cfd-b613-07ebe55ef4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:11.207625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738887e-ce46-4cfd-b613-07ebe55ef4bc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:11.207625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738887e-ce46-4cfd-b613-07ebe55ef4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:11.207625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738887e-ce46-4cfd-b613-07ebe55ef4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:11.208170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738887e-ce46-4cfd-b613-07ebe55ef4bc None admin] RBAC: Adding query filter params (role.id=c40981e1b3ca4fcbaeba6a24898fc8b2, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe, user.id=7f52b14e89c54e648cdc4739c554523b) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:11.208463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738887e-ce46-4cfd-b613-07ebe55ef4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:11.209943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738887e-ce46-4cfd-b613-07ebe55ef4bc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:11.217026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 111/207] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:11 2022] GET /identity/v3/role_assignments?user.id=7f52b14e89c54e648cdc4739c554523b&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:11.271632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf16d-aa1f-4ebc-a67f-17e220144689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:11.272751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf16d-aa1f-4ebc-a67f-17e220144689 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:11.273281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf16d-aa1f-4ebc-a67f-17e220144689 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:11.273748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf16d-aa1f-4ebc-a67f-17e220144689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:11.274692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cf16d-aa1f-4ebc-a67f-17e220144689 None admin] RBAC: Adding query filter params (role.id=916c024b775b4858ba18c731196163a6, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=f735a7c9699a40c9a81361577cefaaf7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:11.275199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cf16d-aa1f-4ebc-a67f-17e220144689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:11.277511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cf16d-aa1f-4ebc-a67f-17e220144689 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:11.284758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 97/208] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:11 2022] GET /identity/v3/role_assignments?user.id=f735a7c9699a40c9a81361577cefaaf7&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=916c024b775b4858ba18c731196163a6 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:12.629751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc154b-1f7d-46b8-a8e3-056b73132810 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:12.630259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc154b-1f7d-46b8-a8e3-056b73132810 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:12.630334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc154b-1f7d-46b8-a8e3-056b73132810 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:12.631841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 112/209] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:12.637841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce78a6-ce07-45da-88c3-11d9c1f053ba None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:12.638301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce78a6-ce07-45da-88c3-11d9c1f053ba None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:12.638377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce78a6-ce07-45da-88c3-11d9c1f053ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:12.656566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7fce78a6-ce07-45da-88c3-11d9c1f053ba None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:12.657753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7fce78a6-ce07-45da-88c3-11d9c1f053ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:12.721998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:12.731872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 98/210] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:12.794798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4a0d-3800-47ee-ac9e-ca9825d70113 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:12.795087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4a0d-3800-47ee-ac9e-ca9825d70113 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:12.795371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4a0d-3800-47ee-ac9e-ca9825d70113 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:12.797002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 113/211] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:12.802388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296a3cb-8ea8-426c-b27b-e89e7d960cd8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:12.802681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296a3cb-8ea8-426c-b27b-e89e7d960cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:12.802956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296a3cb-8ea8-426c-b27b-e89e7d960cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:12.821821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2296a3cb-8ea8-426c-b27b-e89e7d960cd8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:12.823003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2296a3cb-8ea8-426c-b27b-e89e7d960cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:12.892339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 99/212] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:12.979450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c1c0-9f21-4864-bbf3-bf9557b99348 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:12.979797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c1c0-9f21-4864-bbf3-bf9557b99348 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:12.980067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c1c0-9f21-4864-bbf3-bf9557b99348 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:12.981992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 114/213] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:12.987054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d36e-9e01-42a2-b008-2dc306733da6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:12.987345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d36e-9e01-42a2-b008-2dc306733da6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:12.987660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d36e-9e01-42a2-b008-2dc306733da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.006227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8704d36e-9e01-42a2-b008-2dc306733da6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:13.007405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8704d36e-9e01-42a2-b008-2dc306733da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:13.010860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174c1c0-9f21-4864-bbf3-bf9557b99348 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:13.085368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 100/214] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:13.137688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174c1c0-9f21-4864-bbf3-bf9557b99348 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:13.173133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:13.173690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:13.173973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:13.174251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.175367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:13.176880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:13.178751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 115/215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:13.184880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704d36e-9e01-42a2-b008-2dc306733da6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:13.196704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:13.223809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:13.331970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:13.387767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c3cd-4067-4e12-94b3-ff2413c29ba0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:13.395762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704d36e-9e01-42a2-b008-2dc306733da6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:13.443258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:13.443718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:13.444002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:13.444274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.445727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275103cf-65aa-4650-b3e2-2b7186d01f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:13.446568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275103cf-65aa-4650-b3e2-2b7186d01f3d None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:13.447088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275103cf-65aa-4650-b3e2-2b7186d01f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:13.447560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275103cf-65aa-4650-b3e2-2b7186d01f3d None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.449371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275103cf-65aa-4650-b3e2-2b7186d01f3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:13.451042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275103cf-65aa-4650-b3e2-2b7186d01f3d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:13.459661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:13.466681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:13.467623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:13.468564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 116/216] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:13.472409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:13.482056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 101/217] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:13 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:13.485109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132a0dd-af78-4c75-9efe-0703792df0b6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:13.485568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132a0dd-af78-4c75-9efe-0703792df0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:13.486656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132a0dd-af78-4c75-9efe-0703792df0b6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.489356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 102/218] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:13.491304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132a0dd-af78-4c75-9efe-0703792df0b6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:13.630963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:13.662950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3a37c-029e-4a41-9803-20ef039108d9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:13.703297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132a0dd-af78-4c75-9efe-0703792df0b6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:13.718141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10721cb2-b8ec-4413-90b6-106056abdf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:13.718803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721cb2-b8ec-4413-90b6-106056abdf01 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:13.719091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721cb2-b8ec-4413-90b6-106056abdf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:13.719369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721cb2-b8ec-4413-90b6-106056abdf01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.740190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:13.741807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10721cb2-b8ec-4413-90b6-106056abdf01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-10721cb2-b8ec-4413-90b6-106056abdf01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:13.752664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:13.753603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:13.754406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 117/219] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:13.757419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7aa8-0c86-448e-8625-6992017af36f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:13.757419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7aa8-0c86-448e-8625-6992017af36f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:13.757419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7aa8-0c86-448e-8625-6992017af36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.783955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:13.785262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:13.785262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:13.785262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:13.786495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:13.786495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:13.787501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:13.793498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b49e7aa8-0c86-448e-8625-6992017af36f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:13.793754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b49e7aa8-0c86-448e-8625-6992017af36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:13.800562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 103/220] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:13.801287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:13.904022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 118/221] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:13.904930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7aa8-0c86-448e-8625-6992017af36f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:13.931727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd19d8-4064-4295-8e71-a4ff5244c057 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.000837 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.001647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.001937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.002213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.002891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:14.003202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.004623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.022362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 104/222] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:14.028574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.031929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:14.063714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7aa8-0c86-448e-8625-6992017af36f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.099625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.100280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.100563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.100839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] PATH_INFO: `/v3/users/2d397feda86248d8bb7cc5a631db634a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.107054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:14.117553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] RBAC: Authorizing `identity:get_user(user_id=2d397feda86248d8bb7cc5a631db634a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.119063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.122110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 119/223] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:13 2022] GET /identity/v3/users/2d397feda86248d8bb7cc5a631db634a => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:14.129434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.240212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a588-1801-4401-b516-1fcb7ee563dc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.255715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe215-fe6e-46be-9b71-1492fa8d3a8c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.271663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:14.277927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.278621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.278970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.279310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.312299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.313070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.313361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.313645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] PATH_INFO: `/v3/users/f735a7c9699a40c9a81361577cefaaf7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.314868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f735a7c9699a40c9a81361577cefaaf7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.316638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.318656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 105/224] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/users/f735a7c9699a40c9a81361577cefaaf7 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:14.319515 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.352724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.354223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.450126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e00672-38c9-4505-9e39-3e667cb6c3c9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.465430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:14.466410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 120/225] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:14.467250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.492419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.493059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.493343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.493621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.504949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:14.507468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:14.509810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:14.510692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:14.512253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 106/226] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:14.513472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.598377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304143-b214-4a88-bd4f-e48d03d0d872 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.620053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4c1d-3b39-47b0-921f-a5dbfb66fecc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.641929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.642662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.643026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.643370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.644678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.646219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.647941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 121/227] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:14.648841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.663242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.664186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.664472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.664751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.666144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.668632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.671150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 107/228] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:14.672023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.729221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:14.763650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd1f6-d2f9-4b38-8de0-9af8db631fbb None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.772010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:14.809871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.810704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.810968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.811321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.812204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:14.812591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.813030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2418ca-5f5c-4028-ae18-af7190bdc185 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:14.814195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.824095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 122/229] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:14.829548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:14.856960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:14.857765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:14.858254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:14.858598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e/users/f735a7c9699a40c9a81361577cefaaf7/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:14.861379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b859fb448947c18435e17df26ae36e, user_id=f735a7c9699a40c9a81361577cefaaf7, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:14.863511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:14.880458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 108/230] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:14 2022] PUT /identity/v3/projects/d9b859fb448947c18435e17df26ae36e/users/f735a7c9699a40c9a81361577cefaaf7/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:14.881628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:15.001606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:15.008574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f6710-bec6-43e2-938f-60c451ef6021 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:15.009427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616205-70c6-436e-b0a9-5a27e39b3b15 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:15.051809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:15.052547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.052928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.053303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] PATH_INFO: `/v3/users/f735a7c9699a40c9a81361577cefaaf7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.054603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] RBAC: Authorizing `identity:get_user(user_id=f735a7c9699a40c9a81361577cefaaf7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:15.056263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:15.059516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 109/231] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/users/f735a7c9699a40c9a81361577cefaaf7 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:15.068782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:15.097441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:15.098859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.099148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.099665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.100429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=2d397feda86248d8bb7cc5a631db634a) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:15.100759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:15.104981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:15.118685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 123/232] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:14 2022] GET /identity/v3/role_assignments?user.id=2d397feda86248d8bb7cc5a631db634a&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=6491db22b7294223a5a590b58c543f4c => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:15.224464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c6dd3-e752-4df4-b89e-6fb0a0ee4a6b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:15.264444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a358d-3983-44ec-ba5e-0c6a671a2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:15.265101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a358d-3983-44ec-ba5e-0c6a671a2848 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.265388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a358d-3983-44ec-ba5e-0c6a671a2848 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.265722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a358d-3983-44ec-ba5e-0c6a671a2848 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.266989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a358d-3983-44ec-ba5e-0c6a671a2848 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:15.268607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a358d-3983-44ec-ba5e-0c6a671a2848 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:15.270305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 110/233] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:15 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:15.276425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:15.314478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:15.415413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1070ab6-3b0f-4f20-ad05-1b115a8d927b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:15.465211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fcc4b-929b-419b-864a-646973e0837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:15.466108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fcc4b-929b-419b-864a-646973e0837c None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.466398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fcc4b-929b-419b-864a-646973e0837c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.466676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fcc4b-929b-419b-864a-646973e0837c None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e/users/f735a7c9699a40c9a81361577cefaaf7/roles/916c024b775b4858ba18c731196163a6` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.471359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fcc4b-929b-419b-864a-646973e0837c None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b859fb448947c18435e17df26ae36e, user_id=f735a7c9699a40c9a81361577cefaaf7, role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:15.472877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fcc4b-929b-419b-864a-646973e0837c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:15.493000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 124/234] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:15 2022] PUT /identity/v3/projects/d9b859fb448947c18435e17df26ae36e/users/f735a7c9699a40c9a81361577cefaaf7/roles/916c024b775b4858ba18c731196163a6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:15.867734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882173-4b16-43fa-a2ff-9387a03a72f9 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.868233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882173-4b16-43fa-a2ff-9387a03a72f9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.868307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e882173-4b16-43fa-a2ff-9387a03a72f9 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.869623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 111/235] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:15.875458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5137b5-2039-4686-adfe-c8cb01b78393 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.875907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5137b5-2039-4686-adfe-c8cb01b78393 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.876088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5137b5-2039-4686-adfe-c8cb01b78393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.901318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7b5137b5-2039-4686-adfe-c8cb01b78393 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:15.903074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7b5137b5-2039-4686-adfe-c8cb01b78393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:15.925197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3919b-389d-46b4-ae50-7b75b9a1334a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.925493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3919b-389d-46b4-ae50-7b75b9a1334a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.925764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3919b-389d-46b4-ae50-7b75b9a1334a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.927362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 112/236] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:15.932484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cd58e-fada-406a-9e4c-13dc15f80051 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:15.932773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cd58e-fada-406a-9e4c-13dc15f80051 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:15.933088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cd58e-fada-406a-9e4c-13dc15f80051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:15.953436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9b0cd58e-fada-406a-9e4c-13dc15f80051 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:15.954640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b0cd58e-fada-406a-9e4c-13dc15f80051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:15.986696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:16.000460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 125/237] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:16.058141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 113/238] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:16.373294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5137b5-2039-4686-adfe-c8cb01b78393 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:16.395126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:16.487042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cd58e-fada-406a-9e4c-13dc15f80051 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:16.508336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5137b5-2039-4686-adfe-c8cb01b78393 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:16.577871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:16.578676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:16.579247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:16.579548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:16.606011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:16.610905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:16.611817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:16.612619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:16.614623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 126/239] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:16.619556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:16.653098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cd58e-fada-406a-9e4c-13dc15f80051 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:16.723804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:16.724453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:16.724738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:16.725017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:16.728329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:16.729784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:16.731572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 114/240] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:16.738268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:16.769943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:16.806434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:16.819685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461645-4c9f-403c-b859-7737f9c0ccf5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:16.884410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:16.885021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:16.885323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:16.885660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:16.887051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:16.887521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:16.889188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:16.892528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f1f1-5c74-4392-bca0-d592da34349a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:16.915396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 127/241] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:16.920997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:16.928085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:16.929523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:16.929808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:16.930084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:16.930741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:16.932234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:16.958488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 115/242] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:16 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:17.111892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5cd26-8b96-4c7f-91fa-8a2f9b4e0d96 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:17.163126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc5f8b-e390-412b-a326-479e8c141f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:17.163795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc5f8b-e390-412b-a326-479e8c141f47 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.164133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc5f8b-e390-412b-a326-479e8c141f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.164421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc5f8b-e390-412b-a326-479e8c141f47 None admin] PATH_INFO: `/v3/users/8dc1a0c5e7994857861e6dd212aab819` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.167294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:17.182576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc5f8b-e390-412b-a326-479e8c141f47 None admin] RBAC: Authorizing `identity:get_user(user_id=8dc1a0c5e7994857861e6dd212aab819)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:17.184797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc5f8b-e390-412b-a326-479e8c141f47 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:17.186747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 128/243] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:16 2022] GET /identity/v3/users/8dc1a0c5e7994857861e6dd212aab819 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:17.192380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:17.284280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:17.300053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a66886-885b-435e-ae1c-9915f182c923 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:17.336652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:17.337278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.337561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.337836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.411262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fdfdb-b702-4895-aafc-b3958674fbe5 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.411584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fdfdb-b702-4895-aafc-b3958674fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.411853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fdfdb-b702-4895-aafc-b3958674fbe5 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.413338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 129/244] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:25:17.414946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84cb-f170-4af9-84de-1b65b37d67b7 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.415435 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84cb-f170-4af9-84de-1b65b37d67b7 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.415966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84cb-f170-4af9-84de-1b65b37d67b7 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.418365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 130/245] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:17.422791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:17.422791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:17.424491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c67a-fd72-48de-9a35-2be368278fd5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.424878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c67a-fd72-48de-9a35-2be368278fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.425379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c67a-fd72-48de-9a35-2be368278fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.445153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3983c67a-fd72-48de-9a35-2be368278fd5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:17.447301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3983c67a-fd72-48de-9a35-2be368278fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:17.538133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:17.557795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 131/246] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:17.559916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9b549-d81b-4555-9053-1014b4ae29e8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.560207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9b549-d81b-4555-9053-1014b4ae29e8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.560484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9b549-d81b-4555-9053-1014b4ae29e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.561477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 116/247] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:17.567298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:17.582211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b1b9b549-d81b-4555-9053-1014b4ae29e8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:17.584267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b1b9b549-d81b-4555-9053-1014b4ae29e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:17.677848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 132/248] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:17.694223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2ead6-6db5-4e23-86d6-edfdbf9fffc4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:17.729791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:17.731130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.731416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.731719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.732868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:17.734333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:17.736314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 117/249] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:17 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:17.741792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9b549-d81b-4555-9053-1014b4ae29e8 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:17.822524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:17.880494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9b549-d81b-4555-9053-1014b4ae29e8 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:17.925662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:17.927075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:17.927557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:17.928123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:17.929064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] RBAC: Adding query filter params (role.id=c40981e1b3ca4fcbaeba6a24898fc8b2, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=8dc1a0c5e7994857861e6dd212aab819) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:17.929579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:17.931313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:17.934725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:17.946753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 133/250] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:17 2022] GET /identity/v3/role_assignments?user.id=8dc1a0c5e7994857861e6dd212aab819&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:18.005568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:18.075549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb23a0-ef2f-4363-a788-c5cfec0210e8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:18.134025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:18.134680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.134967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.135246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.155529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:18.160985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:18.161865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:18.163074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 118/251] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:18.168663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:18.227697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:18.301222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc292-50ab-424f-8132-a32fa5507290 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:18.324603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:18.339401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:18.340521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.341004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.341501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.342438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:18.342940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:18.344560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:18.353962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 134/252] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:18.361564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:18.393687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f258ac-9239-4c57-8fe1-4a21e0357af4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:18.418548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:18.450423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4b13e-03b9-44bc-bb23-b5d03571ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:18.451073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b13e-03b9-44bc-bb23-b5d03571ef3e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.451360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b13e-03b9-44bc-bb23-b5d03571ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.451667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b13e-03b9-44bc-bb23-b5d03571ef3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.466823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b13e-03b9-44bc-bb23-b5d03571ef3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:18.481469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46d891-eaa2-4273-ba14-eb948fdbebee None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1ee4b13e-03b9-44bc-bb23-b5d03571ef3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:18.484810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:18.485708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:18.486909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 119/253] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:18.487569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81ad3d-7093-4769-bbb6-615a5422dfe2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.487569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81ad3d-7093-4769-bbb6-615a5422dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.496546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81ad3d-7093-4769-bbb6-615a5422dfe2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.497990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 120/254] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:18.498761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81ad3d-7093-4769-bbb6-615a5422dfe2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:18.523699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8b6b-36bb-452f-9c5b-d00b046e366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:18.524741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8b6b-36bb-452f-9c5b-d00b046e366b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.525223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8b6b-36bb-452f-9c5b-d00b046e366b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.525739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8b6b-36bb-452f-9c5b-d00b046e366b None admin] PATH_INFO: `/v3/users/f735a7c9699a40c9a81361577cefaaf7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.527768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8b6b-36bb-452f-9c5b-d00b046e366b None admin] RBAC: Authorizing `identity:get_user(user_id=f735a7c9699a40c9a81361577cefaaf7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:18.529445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8b6b-36bb-452f-9c5b-d00b046e366b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:18.531267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 135/255] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:18 2022] GET /identity/v3/users/f735a7c9699a40c9a81361577cefaaf7 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:18.532781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3c87-afd6-499f-bbe2-d7c4f071393a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.533289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3c87-afd6-499f-bbe2-d7c4f071393a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.533824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3c87-afd6-499f-bbe2-d7c4f071393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.553238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0a4a3c87-afd6-499f-bbe2-d7c4f071393a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:18.554868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0a4a3c87-afd6-499f-bbe2-d7c4f071393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:18.610974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:18.638506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 136/256] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:18.640303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3c87-afd6-499f-bbe2-d7c4f071393a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:18.749910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3c87-afd6-499f-bbe2-d7c4f071393a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:18.794182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:18.795181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.797161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.797714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.820345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81ad3d-7093-4769-bbb6-615a5422dfe2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:18.872031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:18.894951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:18.896842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:18.964865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:18.965479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:18.965765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:18.966045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:18.966744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:18.967038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:18.968473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:18.997923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 121/257] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:19.003219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.007083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 137/258] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:19.017586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.071143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:19.169323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:19.192952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c98dee-0ba3-41cf-8c49-33031f91e56f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.205994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315c622-2235-4531-a55e-f9dfb8075446 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.252526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:19.253204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:19.253548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:19.253774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] PATH_INFO: `/v3/users/2d397feda86248d8bb7cc5a631db634a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:19.255057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] RBAC: Authorizing `identity:get_user(user_id=2d397feda86248d8bb7cc5a631db634a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:19.256987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:19.259737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 122/259] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:19 2022] GET /identity/v3/users/2d397feda86248d8bb7cc5a631db634a => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:19.260540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.281908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:19.282566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:19.282850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:19.283130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:19.284311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:19.285789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:19.290048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 138/260] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:19 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:19.290840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.451679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e940c-61c5-411b-988c-e5c2b625da00 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.455669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:19.475850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38966ff2-6904-4242-87a0-1759da703855 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.498061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:19.500715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:19.501001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:19.503002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:19.523455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:19.528458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:19.529411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 123/261] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:19.530582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.554720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:19.555364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:19.555669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:19.555951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:19.557258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:19.559270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:19.563533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 139/262] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:19 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:19.565680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.599583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:19.700981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96161c-6a74-468a-a146-dc69f09ed8c9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.713337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f95c-b6ec-41bf-a1c5-13f0d8bcf042 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.742554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:19.743180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:19.743464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:19.743774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:19.744452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:19.744759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:19.747584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:19.756690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 140/263] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:19.757706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.777893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5eb3b-b4ea-47c8-a025-bae6ec5bdd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:19.778877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5eb3b-b4ea-47c8-a025-bae6ec5bdd69 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:19.779378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5eb3b-b4ea-47c8-a025-bae6ec5bdd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:19.779906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5eb3b-b4ea-47c8-a025-bae6ec5bdd69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:19.780928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5eb3b-b4ea-47c8-a025-bae6ec5bdd69 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=f735a7c9699a40c9a81361577cefaaf7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:19.781448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5eb3b-b4ea-47c8-a025-bae6ec5bdd69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:19.783143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5eb3b-b4ea-47c8-a025-bae6ec5bdd69 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:19.789723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 124/264] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:19 2022] GET /identity/v3/role_assignments?user.id=f735a7c9699a40c9a81361577cefaaf7&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:19.791241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7856bb-c71e-4982-9d1d-64da3004ae09 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:19.791808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7856bb-c71e-4982-9d1d-64da3004ae09 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:19.792913 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7856bb-c71e-4982-9d1d-64da3004ae09 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:19.794362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 125/265] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:19.799885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7856bb-c71e-4982-9d1d-64da3004ae09 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:19.859992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:19.949496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:19.953678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7856bb-c71e-4982-9d1d-64da3004ae09 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.988118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d8e8-6311-43ab-918c-b978c587c328 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:19.999219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df6899-7069-48d3-a46f-abe6736335bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:19.999985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6899-7069-48d3-a46f-abe6736335bd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.000191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6899-7069-48d3-a46f-abe6736335bd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.000470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6899-7069-48d3-a46f-abe6736335bd None admin] PATH_INFO: `/v3/users/f735a7c9699a40c9a81361577cefaaf7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.002214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df6899-7069-48d3-a46f-abe6736335bd None admin] RBAC: Authorizing `identity:get_user(user_id=f735a7c9699a40c9a81361577cefaaf7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:20.004340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df6899-7069-48d3-a46f-abe6736335bd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:20.006442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 126/266] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:19 2022] GET /identity/v3/users/f735a7c9699a40c9a81361577cefaaf7 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:20.007611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65694505-2059-4524-9f4a-86265419527e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.007921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65694505-2059-4524-9f4a-86265419527e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.008199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65694505-2059-4524-9f4a-86265419527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.031169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-65694505-2059-4524-9f4a-86265419527e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:20.032357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-65694505-2059-4524-9f4a-86265419527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:20.034604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:20.035287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.035573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.036699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e/users/2d397feda86248d8bb7cc5a631db634a/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.038680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b859fb448947c18435e17df26ae36e, user_id=2d397feda86248d8bb7cc5a631db634a, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:20.040201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:20.060467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 141/267] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:19 2022] PUT /identity/v3/projects/d9b859fb448947c18435e17df26ae36e/users/2d397feda86248d8bb7cc5a631db634a/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:20.061387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:20.124864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 127/268] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:20.195100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc116ee-81c4-4238-921f-032965a9ece1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:20.235078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:20.235735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.236088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.236375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.240148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:20.297789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc7b5-3ed0-44ef-8599-48c81712b1ea None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.298089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc7b5-3ed0-44ef-8599-48c81712b1ea None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.298295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bc7b5-3ed0-44ef-8599-48c81712b1ea None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.300358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 128/269] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:20.306070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbab63-f3d4-42ec-b38b-b84d1f9d8a14 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.306362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbab63-f3d4-42ec-b38b-b84d1f9d8a14 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.306643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbab63-f3d4-42ec-b38b-b84d1f9d8a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.316720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:20.318313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:20.327140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3dbab63-f3d4-42ec-b38b-b84d1f9d8a14 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:20.328404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3dbab63-f3d4-42ec-b38b-b84d1f9d8a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:20.350703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:20.408056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 129/270] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:20.433526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 142/271] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:20.438858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbab63-f3d4-42ec-b38b-b84d1f9d8a14 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:20.462783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:20.509481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:20.583382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbab63-f3d4-42ec-b38b-b84d1f9d8a14 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:20.607565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bac6e-ad3c-443b-9aeb-e019e0b01500 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:20.618761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4533a5-a104-4110-8720-29469a15a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:20.619723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4533a5-a104-4110-8720-29469a15a46a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.620205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4533a5-a104-4110-8720-29469a15a46a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.620964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4533a5-a104-4110-8720-29469a15a46a None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.622302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4533a5-a104-4110-8720-29469a15a46a None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:20.624000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4533a5-a104-4110-8720-29469a15a46a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:20.625811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 130/272] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:20 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:20.626948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4613-2d70-44d8-aa43-36512eaca286 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.627241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4613-2d70-44d8-aa43-36512eaca286 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.627513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4613-2d70-44d8-aa43-36512eaca286 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.628873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 131/273] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:20.631175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4613-2d70-44d8-aa43-36512eaca286 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:20.657293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd737-f4ff-47ee-a264-7f96f3c2b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:20.657990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd737-f4ff-47ee-a264-7f96f3c2b910 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.658272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd737-f4ff-47ee-a264-7f96f3c2b910 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.658593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd737-f4ff-47ee-a264-7f96f3c2b910 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.664204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:20.672060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfd737-f4ff-47ee-a264-7f96f3c2b910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f5cfd737-f4ff-47ee-a264-7f96f3c2b910 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:20.677119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:20.678018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:20.678819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 143/274] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:20.684369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965af7-378c-4c2d-8a9d-da90bd627902 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.684676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965af7-378c-4c2d-8a9d-da90bd627902 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.684952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965af7-378c-4c2d-8a9d-da90bd627902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.703840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-26965af7-378c-4c2d-8a9d-da90bd627902 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:20.705027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-26965af7-378c-4c2d-8a9d-da90bd627902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:20.763235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4613-2d70-44d8-aa43-36512eaca286 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:20.773622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 144/275] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:20.780492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965af7-378c-4c2d-8a9d-da90bd627902 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:20.802695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:20.803356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.803678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.804214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.804748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] RBAC: Adding query filter params (role.id=916c024b775b4858ba18c731196163a6, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=f735a7c9699a40c9a81361577cefaaf7) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:20.805065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:20.806589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:20.819620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 132/276] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:20 2022] GET /identity/v3/role_assignments?user.id=f735a7c9699a40c9a81361577cefaaf7&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=916c024b775b4858ba18c731196163a6 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:20.819620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:20.836350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:20.930464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:20.936996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e6f87-b0b5-4013-a7db-4017d2793b55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:20.974945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:20.975610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:20.975899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:20.976181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:20.977313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:20.978782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:20.980987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 133/277] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:20.991370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:21.018623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965af7-378c-4c2d-8a9d-da90bd627902 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.060530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.061271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.061460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.062477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.063241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:21.063553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:21.064996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:21.075061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 145/278] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:21.080856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:21.104918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32fe7-3c89-49a6-b764-50ea7f034dd9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.142042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.142659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.142949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.143226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.143933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:21.145400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:21.173054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 134/279] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:20 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:21.174134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:21.194973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:21.212904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:21.240682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8805674-853a-4de4-a781-4890c91109d2 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.295488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.296175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.296455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.296726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] PATH_INFO: `/v3/users/2abcdb2451544f129d4e7037660d70d2` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.312191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917547b-07e1-454c-868c-c42079d29404 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.321822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] RBAC: Authorizing `identity:get_user(user_id=2abcdb2451544f129d4e7037660d70d2)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:21.324473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:21.327451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 146/280] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:21 2022] GET /identity/v3/users/2abcdb2451544f129d4e7037660d70d2 => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:21.333274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:21.361219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.361795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.362338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.362625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.377903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:21.383879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:21.385459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:21.386574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 135/281] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:21.391127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:21.464638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b39a0-e2ee-4645-9a3e-caa6fa3bf162 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.482690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:21.519295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.519962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.520244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.520518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.521682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, user.id=2abcdb2451544f129d4e7037660d70d2, scope.system=all) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:21.522023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:21.523972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:21.531695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 147/282] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Sep 5 10:25:21 2022] GET /identity/v3/role_assignments?user.id=2abcdb2451544f129d4e7037660d70d2&scope.system=all&role.id=6491db22b7294223a5a590b58c543f4c => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:21.536538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce05cf0-0e60-4f03-8847-4225dfccbe33 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.577032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.577663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.577948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.578222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.578963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:21.579277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:21.580710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:21.591270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 136/283] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:21.596775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:21.611517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:21.716830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc36fc-1f3a-4908-93f2-cac424ac7b21 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.757841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.758495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.758783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.759064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] PATH_INFO: `/v3/users/8dc1a0c5e7994857861e6dd212aab819` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.760228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] RBAC: Authorizing `identity:get_user(user_id=8dc1a0c5e7994857861e6dd212aab819)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:21.765044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:21.766672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 148/284] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:21 2022] GET /identity/v3/users/8dc1a0c5e7994857861e6dd212aab819 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:21.772278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:21.916123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335d313-0c55-4aa8-b3f7-074b0f5cb16f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:21.962352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a788-9c57-4cde-83f1-5eb8b0b5e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:21.963061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a788-9c57-4cde-83f1-5eb8b0b5e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:21.963353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a788-9c57-4cde-83f1-5eb8b0b5e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:21.963652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a788-9c57-4cde-83f1-5eb8b0b5e0f3 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:21.965356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a788-9c57-4cde-83f1-5eb8b0b5e0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:21.966920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a788-9c57-4cde-83f1-5eb8b0b5e0f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:21.968605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 137/285] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:21 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:21.974320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:22.077730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:22.115429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf823e7-49c9-4355-bc5d-404e5fe4d188 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:22.167027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74732e-b557-4e0d-aee9-b862270735a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:22.167737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74732e-b557-4e0d-aee9-b862270735a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:22.168029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74732e-b557-4e0d-aee9-b862270735a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:22.168294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74732e-b557-4e0d-aee9-b862270735a4 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e/users/8dc1a0c5e7994857861e6dd212aab819/roles/c40981e1b3ca4fcbaeba6a24898fc8b2` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:22.176327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74732e-b557-4e0d-aee9-b862270735a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b859fb448947c18435e17df26ae36e, user_id=8dc1a0c5e7994857861e6dd212aab819, role_id=c40981e1b3ca4fcbaeba6a24898fc8b2)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:22.177788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74732e-b557-4e0d-aee9-b862270735a4 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:22.194377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 149/286] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:25:21 2022] PUT /identity/v3/projects/d9b859fb448947c18435e17df26ae36e/users/8dc1a0c5e7994857861e6dd212aab819/roles/c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:22.468449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd938f-06db-4ccb-8924-fbbffd0aba6b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:22.469405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd938f-06db-4ccb-8924-fbbffd0aba6b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:22.469886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd938f-06db-4ccb-8924-fbbffd0aba6b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:22.471718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 138/287] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:22.478092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a15ac6-9a61-4e8d-9322-167ee52c9f12 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:22.478668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a15ac6-9a61-4e8d-9322-167ee52c9f12 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:22.479141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a15ac6-9a61-4e8d-9322-167ee52c9f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:22.499905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-70a15ac6-9a61-4e8d-9322-167ee52c9f12 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:22.501576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-70a15ac6-9a61-4e8d-9322-167ee52c9f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:22.583714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 150/288] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:22.945178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd938f-06db-4ccb-8924-fbbffd0aba6b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:22.948244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:23.059984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd938f-06db-4ccb-8924-fbbffd0aba6b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:23.097390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:23.098421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.098926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.099413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.111445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:23.116743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:23.117611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:23.118390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:23.122240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 139/289] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:23.132800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a15ac6-9a61-4e8d-9322-167ee52c9f12 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:23.236158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:23.279605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a15ac6-9a61-4e8d-9322-167ee52c9f12 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:23.329731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:23.330348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.330626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.330899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.331571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:23.331901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:23.333279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:23.343832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 151/290] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:23.349903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:23.441887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:23.495785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3e1f9-2f7f-489c-b0ee-fac31ea9f18a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:23.543025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b136ba-f000-4626-a954-810e24729c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:23.544080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b136ba-f000-4626-a954-810e24729c28 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.544564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b136ba-f000-4626-a954-810e24729c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.545033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b136ba-f000-4626-a954-810e24729c28 None admin] PATH_INFO: `/v3/users/2d397feda86248d8bb7cc5a631db634a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.547278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b136ba-f000-4626-a954-810e24729c28 None admin] RBAC: Authorizing `identity:get_user(user_id=2d397feda86248d8bb7cc5a631db634a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:23.549069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b136ba-f000-4626-a954-810e24729c28 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:23.551223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 140/291] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:23 2022] GET /identity/v3/users/2d397feda86248d8bb7cc5a631db634a => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:23.560709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:23.683313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f0a5-9d29-4ef1-a333-6d8387a385ca None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:23.717632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:23.729446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:23.730330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.730628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.730969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.802230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3660-25e3-4c7e-9694-624d99c79231 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.802413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3660-25e3-4c7e-9694-624d99c79231 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.802689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3660-25e3-4c7e-9694-624d99c79231 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.804249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 141/292] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:25:23.809397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:23.811004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:23.815133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ca70-29fc-4849-9b54-4cefa66eccc0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.815416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ca70-29fc-4849-9b54-4cefa66eccc0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.815728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ca70-29fc-4849-9b54-4cefa66eccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.842283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0c12ca70-29fc-4849-9b54-4cefa66eccc0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:23.843484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c12ca70-29fc-4849-9b54-4cefa66eccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:23.941189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 142/293] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:23.943017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f2cd-7472-4a0a-be0b-a87a820cc607 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.943506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f2cd-7472-4a0a-be0b-a87a820cc607 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.944014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f2cd-7472-4a0a-be0b-a87a820cc607 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.945721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 143/294] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:23.956840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e9e0-3dde-44c5-98e5-69585f30a560 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:23.957424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e9e0-3dde-44c5-98e5-69585f30a560 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:23.957914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77e9e0-3dde-44c5-98e5-69585f30a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:23.976755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1a77e9e0-3dde-44c5-98e5-69585f30a560 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:23.977740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 152/295] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:23.983612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1a77e9e0-3dde-44c5-98e5-69585f30a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:23.984685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.027976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.073221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.087628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 144/296] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:24.087628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94367f4-e168-4c31-9976-6209e2532bbc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.087628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94367f4-e168-4c31-9976-6209e2532bbc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.087904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94367f4-e168-4c31-9976-6209e2532bbc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.093574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 145/297] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:24.097445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321ff03-d07d-4b86-b442-1457f8648471 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.097733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321ff03-d07d-4b86-b442-1457f8648471 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.098008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321ff03-d07d-4b86-b442-1457f8648471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.131629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f321ff03-d07d-4b86-b442-1457f8648471 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:24.131629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f321ff03-d07d-4b86-b442-1457f8648471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:24.147787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940acf-4d9e-42f2-8001-98d5b59fcae2 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.210069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.210721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.211002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.211279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.212451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:24.213914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:24.216567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 153/298] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:23 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:24.222146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.246972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 146/299] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:24.276274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321ff03-d07d-4b86-b442-1457f8648471 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.388023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.391218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321ff03-d07d-4b86-b442-1457f8648471 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.396382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dde7e-3a4b-44d4-8138-f9b348953cbb None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.414062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.430436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.431079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.431362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.431667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.445501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:24.450906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:24.452080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 147/300] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:24.453330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.462230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.463156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.464053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.464771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.466226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=2d397feda86248d8bb7cc5a631db634a) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:24.466733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:24.469008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:24.476850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 154/301] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:24 2022] GET /identity/v3/role_assignments?user.id=2d397feda86248d8bb7cc5a631db634a&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=6491db22b7294223a5a590b58c543f4c => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:24.478266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.568144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90540-b739-4198-a99d-fea39d603d23 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.607890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.608698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.609086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.609488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.610753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:24.612570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:24.618925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 148/302] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:24.618925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.634608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378c8c-b477-4a59-a27f-e235d0a304c5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.673670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.684899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.685628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.685970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.686185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.686860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:24.687161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:24.688625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:24.704227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 155/303] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:24.706132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.734373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b9b1c-b061-488f-81bd-09c5d4ec66d1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.738445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.782973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.783878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.784264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.784640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.796563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:24.802788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:24.803803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:24.804593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 149/304] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:24.805304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.834190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbabf4-65e5-4bec-bc61-c688186011d2 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.871873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.872493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.872775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.873051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] PATH_INFO: `/v3/groups` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.873688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:24.875150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:24.900338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 156/305] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Sep 5 10:25:24 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:24.900338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:24.927525 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73980b3d-e781-4c6b-8691-f47f61090f41 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:24.938879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.973423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a2110-ec59-473b-9540-a8175e0d283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:24.974082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2110-ec59-473b-9540-a8175e0d283f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:24.974374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2110-ec59-473b-9540-a8175e0d283f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:24.975045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2110-ec59-473b-9540-a8175e0d283f None admin] PATH_INFO: `/v3/users/250fe7fe497e46ffba1c7547356b3952` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:24.993950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a2110-ec59-473b-9540-a8175e0d283f None admin] RBAC: Authorizing `identity:get_user(user_id=250fe7fe497e46ffba1c7547356b3952)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:24.994607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:24.997714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a2110-ec59-473b-9540-a8175e0d283f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:25.004757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 150/306] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:24 2022] GET /identity/v3/users/250fe7fe497e46ffba1c7547356b3952 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:25.004757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df702c-785a-47dd-865b-de9eebde8e67 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.004757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df702c-785a-47dd-865b-de9eebde8e67 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.004757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df702c-785a-47dd-865b-de9eebde8e67 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.004757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 151/307] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:25.005515 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df702c-785a-47dd-865b-de9eebde8e67 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:25.018851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df80ad-32ae-4258-8a03-b526425cc2a9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:25.059923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01d9bd-7797-4bd7-b361-7ba212541587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:25.060544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01d9bd-7797-4bd7-b361-7ba212541587 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.060828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01d9bd-7797-4bd7-b361-7ba212541587 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.061106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01d9bd-7797-4bd7-b361-7ba212541587 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.061772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01d9bd-7797-4bd7-b361-7ba212541587 None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:25.062078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01d9bd-7797-4bd7-b361-7ba212541587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:25.063459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01d9bd-7797-4bd7-b361-7ba212541587 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:25.075488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 157/308] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:25.076984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12e4b-b0ef-46f3-adc2-e1bafb75b780 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.077276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12e4b-b0ef-46f3-adc2-e1bafb75b780 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.077558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12e4b-b0ef-46f3-adc2-e1bafb75b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.100612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-08f12e4b-b0ef-46f3-adc2-e1bafb75b780 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:25.101813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-08f12e4b-b0ef-46f3-adc2-e1bafb75b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:25.128886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df702c-785a-47dd-865b-de9eebde8e67 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:25.171005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:25.171650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.171939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.172215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.179768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] RBAC: Adding query filter params (role.id=c40981e1b3ca4fcbaeba6a24898fc8b2, user.id=250fe7fe497e46ffba1c7547356b3952, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:25.179890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 158/309] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:25.180303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:25.180379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12e4b-b0ef-46f3-adc2-e1bafb75b780 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:25.180445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:25.180445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 152/310] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Sep 5 10:25:25 2022] GET /identity/v3/role_assignments?user.id=250fe7fe497e46ffba1c7547356b3952&scope.system=all&role.id=c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:25.266101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:25.297798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12e4b-b0ef-46f3-adc2-e1bafb75b780 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:25.335178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:25.336686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.336970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.337248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] PATH_INFO: `/v3/users/2abcdb2451544f129d4e7037660d70d2` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.338426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] RBAC: Authorizing `identity:get_user(user_id=2abcdb2451544f129d4e7037660d70d2)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:25.341546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:25.342328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 159/311] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:25 2022] GET /identity/v3/users/2abcdb2451544f129d4e7037660d70d2 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:25.348169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:25.382175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:25.464532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caee06-a2eb-43d6-9945-ed375e377a64 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:25.501039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:25.501726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.502073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.502397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] PATH_INFO: `/v3/system/users/2abcdb2451544f129d4e7037660d70d2/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.503865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2abcdb2451544f129d4e7037660d70d2, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:25.505255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:25.508379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:25.517228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 153/312] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Sep 5 10:25:25 2022] PUT /identity/v3/system/users/2abcdb2451544f129d4e7037660d70d2/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:25.637426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75133f-4892-4129-95b0-ff843b2996fd None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:25.676687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:25.677320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.677596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.677866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.689400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:25.694299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:25.695185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:25.696065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:25.699658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 160/313] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:25.702408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:25.803099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:25.810403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c2121-3c03-4892-b762-ef8d9ba891a0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:25.848086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:25.848679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:25.848957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:25.849293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:25.849963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:25.850266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:25.851657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:25.864934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 154/314] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:25.868655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:25.881220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:25.977777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae286dc6-eb64-4516-8b5c-c7ba7b89a297 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:26.013370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:26.014005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:26.014281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:26.014549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] PATH_INFO: `/v3/users/8dc1a0c5e7994857861e6dd212aab819` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:26.015891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] RBAC: Authorizing `identity:get_user(user_id=8dc1a0c5e7994857861e6dd212aab819)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:26.017405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:26.019286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 161/315] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:25 2022] GET /identity/v3/users/8dc1a0c5e7994857861e6dd212aab819 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:26.024761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:26.137234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1419-aa4d-44c4-a548-d8302973fd55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:26.172957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:26.173576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:26.173861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:26.174140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:26.200824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:26.246590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:26.248099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:26.352654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 155/316] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:26.358945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:26.436417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:26.467540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86a26-1238-46b3-8c47-24db9e1358f6 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:26.502242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1cdc8-118d-4006-9a78-19f1b83736fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:26.503209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1cdc8-118d-4006-9a78-19f1b83736fb None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:26.503715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1cdc8-118d-4006-9a78-19f1b83736fb None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:26.504186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1cdc8-118d-4006-9a78-19f1b83736fb None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:26.505522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1cdc8-118d-4006-9a78-19f1b83736fb None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:26.507230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1cdc8-118d-4006-9a78-19f1b83736fb None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:26.514856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 162/317] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:26 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:26.516472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:26.574980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:26.621654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bbc0e-1584-46ed-8c6c-2105f8bb3316 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:26.656086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c31b2-f309-44ba-8eda-12ebdaf328f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:26.656754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c31b2-f309-44ba-8eda-12ebdaf328f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:26.657040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c31b2-f309-44ba-8eda-12ebdaf328f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:26.657312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c31b2-f309-44ba-8eda-12ebdaf328f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:26.658045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c31b2-f309-44ba-8eda-12ebdaf328f3 None admin] RBAC: Adding query filter params (role.id=c40981e1b3ca4fcbaeba6a24898fc8b2, scope.project.id=d9b859fb448947c18435e17df26ae36e, user.id=8dc1a0c5e7994857861e6dd212aab819) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:26.658356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c31b2-f309-44ba-8eda-12ebdaf328f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:26.659833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c31b2-f309-44ba-8eda-12ebdaf328f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:26.665922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 156/318] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:26 2022] GET /identity/v3/role_assignments?user.id=8dc1a0c5e7994857861e6dd212aab819&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:26.972596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64164-f4f2-403d-91aa-f4b0f6f12398 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:26.972891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64164-f4f2-403d-91aa-f4b0f6f12398 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:26.973304 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64164-f4f2-403d-91aa-f4b0f6f12398 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:26.974902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 163/319] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:26.980208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b216d50-151f-4cb6-ac7c-22424fa7cc55 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:26.981362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b216d50-151f-4cb6-ac7c-22424fa7cc55 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:26.981362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b216d50-151f-4cb6-ac7c-22424fa7cc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:26.999581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4b216d50-151f-4cb6-ac7c-22424fa7cc55 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:27.000802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4b216d50-151f-4cb6-ac7c-22424fa7cc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:27.071120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 157/320] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:27.123115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad868-31c5-4f9c-a323-dfcf18d3110a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.123115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad868-31c5-4f9c-a323-dfcf18d3110a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.123115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad868-31c5-4f9c-a323-dfcf18d3110a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.123632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 164/321] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:27.128869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da25e-a34f-454d-9df0-8cb3e474d48f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.129163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da25e-a34f-454d-9df0-8cb3e474d48f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.129441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33da25e-a34f-454d-9df0-8cb3e474d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.148194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f33da25e-a34f-454d-9df0-8cb3e474d48f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:27.149453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f33da25e-a34f-454d-9df0-8cb3e474d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:27.198018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:27.220909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 158/322] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:27.342710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad868-31c5-4f9c-a323-dfcf18d3110a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:27.446837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad868-31c5-4f9c-a323-dfcf18d3110a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:27.481190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:27.481814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.482097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.482395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.483461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:27.485961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:27.491634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 165/323] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:27.491947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da25e-a34f-454d-9df0-8cb3e474d48f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:27.492811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:27.504715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:27.593167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33da25e-a34f-454d-9df0-8cb3e474d48f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:27.598827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd661f6-a072-4ece-84f0-ceeb8a8fad32 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:27.629025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaa1d6-e309-4532-8960-50f83db8b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:27.629666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa1d6-e309-4532-8960-50f83db8b7cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.629948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa1d6-e309-4532-8960-50f83db8b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.630223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaa1d6-e309-4532-8960-50f83db8b7cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.635872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410082-1084-4126-a35c-4b01a2d90e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:27.636664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410082-1084-4126-a35c-4b01a2d90e88 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.636958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410082-1084-4126-a35c-4b01a2d90e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.637231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410082-1084-4126-a35c-4b01a2d90e88 None admin] PATH_INFO: `/v3/groups` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.637864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54410082-1084-4126-a35c-4b01a2d90e88 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:27.639309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54410082-1084-4126-a35c-4b01a2d90e88 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:27.640413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facaa1d6-e309-4532-8960-50f83db8b7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-facaa1d6-e309-4532-8960-50f83db8b7cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:27.645503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:27.646552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:27.647365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 159/324] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:27.648453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6896fc3-6297-40e8-b913-74d3f736197d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.648543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6896fc3-6297-40e8-b913-74d3f736197d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.648893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6896fc3-6297-40e8-b913-74d3f736197d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.655183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 160/325] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:27.655183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6896fc3-6297-40e8-b913-74d3f736197d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:27.666037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 166/326] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Sep 5 10:25:27 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:25:27.666037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db096-92f9-4822-b09a-39acca138273 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.666037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db096-92f9-4822-b09a-39acca138273 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.666037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db096-92f9-4822-b09a-39acca138273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.679838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3a4db096-92f9-4822-b09a-39acca138273 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:27.681001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3a4db096-92f9-4822-b09a-39acca138273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:27.715985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:27.756853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:27.763761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 167/327] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:27.791144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6896fc3-6297-40e8-b913-74d3f736197d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:27.832224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:27.833064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:27.833484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:27.833892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:27.834715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:27.835171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:27.836763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:27.845529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 161/328] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:27.851034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db096-92f9-4822-b09a-39acca138273 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:27.963831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db096-92f9-4822-b09a-39acca138273 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:28.001074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:28.001716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:28.001998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:28.002272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] PATH_INFO: `/v3/users/250fe7fe497e46ffba1c7547356b3952` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:28.003394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] RBAC: Authorizing `identity:get_user(user_id=250fe7fe497e46ffba1c7547356b3952)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:28.004922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:28.006658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 168/329] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:27 2022] GET /identity/v3/users/250fe7fe497e46ffba1c7547356b3952 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:28.012292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:28.040185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:28.127908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:28.144554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7464-5686-420a-85f2-e1f75f295612 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:28.146339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:28.178642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013429e-5e7d-4c39-bbd4-b36eaff7b566 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:28.197226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:28.198544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:28.199856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:28.200173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] PATH_INFO: `/v3/system/users/250fe7fe497e46ffba1c7547356b3952/roles/c40981e1b3ca4fcbaeba6a24898fc8b2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:28.202148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=250fe7fe497e46ffba1c7547356b3952, role_id=c40981e1b3ca4fcbaeba6a24898fc8b2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:28.204474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:28.213732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 162/330] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Sep 5 10:25:28 2022] PUT /identity/v3/system/users/250fe7fe497e46ffba1c7547356b3952/roles/c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:25:28.237508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:28.238182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:28.238461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:28.238731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:28.259710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:28.267519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:28.268516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:28.269308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:28.271932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 169/331] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:28.278618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:28.406059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa5152-c746-4766-9dc9-b632911bb2bc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:28.442277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:28.442889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:28.443169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:28.443446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:28.444154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:28.444458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:28.445844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:28.456431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 163/332] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:28.461648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:28.585573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f87fa-7865-460e-bb41-e5c6663ad5c9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:28.614459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:28.624203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68ecfd-ac7b-490b-a1df-f580702c6869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:28.624901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68ecfd-ac7b-490b-a1df-f580702c6869 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:28.625234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68ecfd-ac7b-490b-a1df-f580702c6869 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:28.625515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68ecfd-ac7b-490b-a1df-f580702c6869 None admin] PATH_INFO: `/v3/users/2abcdb2451544f129d4e7037660d70d2` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:28.626729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68ecfd-ac7b-490b-a1df-f580702c6869 None admin] RBAC: Authorizing `identity:get_user(user_id=2abcdb2451544f129d4e7037660d70d2)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:28.628232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68ecfd-ac7b-490b-a1df-f580702c6869 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:28.630141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 170/333] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:28 2022] GET /identity/v3/users/2abcdb2451544f129d4e7037660d70d2 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:28.636391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:28.672765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:28.756380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31290-ce37-449b-b203-ccb6c3c8e5df None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:28.797019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5b538-a2cd-456f-8348-60e6ebb759cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:28.797646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5b538-a2cd-456f-8348-60e6ebb759cc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:28.797994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5b538-a2cd-456f-8348-60e6ebb759cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:28.798277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5b538-a2cd-456f-8348-60e6ebb759cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:28.799015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5b538-a2cd-456f-8348-60e6ebb759cc None admin] RBAC: Adding query filter params (role.id=6491db22b7294223a5a590b58c543f4c, user.id=2abcdb2451544f129d4e7037660d70d2, scope.system=all) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:28.799331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5b538-a2cd-456f-8348-60e6ebb759cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:28.800810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5b538-a2cd-456f-8348-60e6ebb759cc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:28.819623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 164/334] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Sep 5 10:25:28 2022] GET /identity/v3/role_assignments?user.id=2abcdb2451544f129d4e7037660d70d2&scope.system=all&role.id=6491db22b7294223a5a590b58c543f4c => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:30.243240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce279bb-bd64-428d-880d-a4fb261552a0 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:30.243758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce279bb-bd64-428d-880d-a4fb261552a0 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:30.243831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce279bb-bd64-428d-880d-a4fb261552a0 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:30.246074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 171/335] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:30.252049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871748b-c47d-4aaa-8bbc-664281f30349 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:30.252495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871748b-c47d-4aaa-8bbc-664281f30349 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:30.252701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871748b-c47d-4aaa-8bbc-664281f30349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:30.273089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e871748b-c47d-4aaa-8bbc-664281f30349 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:30.274287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e871748b-c47d-4aaa-8bbc-664281f30349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:30.283974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb258b-46b8-4c48-a281-9549ae91ccdb None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:30.284255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb258b-46b8-4c48-a281-9549ae91ccdb None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:30.284533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb258b-46b8-4c48-a281-9549ae91ccdb None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:30.286878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 172/336] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:30.293195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfb867-fc54-4b38-8fb2-8c5b7b50db3d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:30.293709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfb867-fc54-4b38-8fb2-8c5b7b50db3d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:30.294208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfb867-fc54-4b38-8fb2-8c5b7b50db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:30.336586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-84cfb867-fc54-4b38-8fb2-8c5b7b50db3d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:30.337779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-84cfb867-fc54-4b38-8fb2-8c5b7b50db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:30.378553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 165/337] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:30.455907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 173/338] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:30.708870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031da3d-2e47-4d91-ac6f-4de1a588e235 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:30.709204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031da3d-2e47-4d91-ac6f-4de1a588e235 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:30.709375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031da3d-2e47-4d91-ac6f-4de1a588e235 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:30.710961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 166/339] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:30.721052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090572e-095e-41b5-afe6-ca3e1dbe25e7 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:30.721340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090572e-095e-41b5-afe6-ca3e1dbe25e7 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:30.721620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090572e-095e-41b5-afe6-ca3e1dbe25e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:30.748621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5090572e-095e-41b5-afe6-ca3e1dbe25e7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:30.749841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5090572e-095e-41b5-afe6-ca3e1dbe25e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:30.829802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 174/340] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:30.845465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031da3d-2e47-4d91-ac6f-4de1a588e235 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:30.872498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:30.962454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090572e-095e-41b5-afe6-ca3e1dbe25e7 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:30.999893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031da3d-2e47-4d91-ac6f-4de1a588e235 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:31.038639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:31.064835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:31.065069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.065284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.065515 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.082332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:31.087637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:31.088542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:31.089383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 167/341] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:31.095127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:31.098234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090572e-095e-41b5-afe6-ca3e1dbe25e7 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:31.142235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:31.143253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.143769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.144249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.159047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:31.165661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:31.166596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:31.168032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:31.171341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 175/342] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:31.177961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:31.243301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:31.292044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fef9b-778f-43dd-a8e9-678977896959 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:31.300737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30642991-6691-4dbe-b37e-7b57d6e1a34d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:31.331669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:31.337671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10c446-ca89-4743-b954-a2242c754ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:31.338388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c446-ca89-4743-b954-a2242c754ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.338776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c446-ca89-4743-b954-a2242c754ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.339201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10c446-ca89-4743-b954-a2242c754ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.340016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c446-ca89-4743-b954-a2242c754ed7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:31.340428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c446-ca89-4743-b954-a2242c754ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:31.341711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:31.342075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10c446-ca89-4743-b954-a2242c754ed7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:31.342369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.342658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.342939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.343647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:31.343962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:31.345588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:31.353767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 168/343] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:31.354858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 176/344] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:31.355057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877308b-e44a-447d-a52d-102c821aeac8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.355346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877308b-e44a-447d-a52d-102c821aeac8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.355654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877308b-e44a-447d-a52d-102c821aeac8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.357010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 169/345] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:31.360102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:31.362743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f42ccf-f353-428b-af71-07fc7cb9208b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.363034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f42ccf-f353-428b-af71-07fc7cb9208b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.363317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f42ccf-f353-428b-af71-07fc7cb9208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.388757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e5f42ccf-f353-428b-af71-07fc7cb9208b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:31.389997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e5f42ccf-f353-428b-af71-07fc7cb9208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:31.466337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 170/346] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:31.467216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f42ccf-f353-428b-af71-07fc7cb9208b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:31.533289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bf453-a046-4d10-a356-0f38ba61ad64 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:31.544923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:31.577415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:31.578029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.578305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.578578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.583069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f42ccf-f353-428b-af71-07fc7cb9208b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:31.622598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:31.623225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.623615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.624506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.633186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:31.660202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:31.661871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:31.779331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 177/347] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:31.780289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:31.832483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:31.833919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:31.859734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:31.887046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d783d-8b6d-4973-9673-bb5105f0790a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:31.922780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:31.923414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:31.923717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:31.923991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:31.930472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:31.946237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:31.952245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:31.953436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:31.954268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 178/348] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:31.958800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:31.981630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 171/349] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:31.982557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.080379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427c40-e4c4-4609-9f93-7ab8e6d5d99e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.114861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d531-7be0-4b41-88ff-2ddfa05ef657 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.128418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.129068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.129351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.129632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.130778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.132790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.135767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 179/350] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:31 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.135767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.142283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:32.165456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.166230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.166601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.166951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.179049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:32.185244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:32.186171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:32.186985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 172/351] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:32.187684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.224789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:32.269419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4350d-ba7a-4112-b736-f79e8d53d115 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.310563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.311287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.311578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.311882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.312554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:32.312861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.314361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.326965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 180/352] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.327922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.334928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b04ba-6e25-47d4-ae67-4767b59739b7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.391889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.393401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.393891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.394585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.396091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.398061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.400384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 173/353] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.402085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.438763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:32.466946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea446eaf-f1cb-48f6-ae46-dd1fbeb22236 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.511520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.512189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.512474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.512753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.524487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.526025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.528446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 181/354] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.529015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.536614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:32.546906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b92fb-0318-4e32-8a71-ea3b6651f627 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.595459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.596535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.596833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.597116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.597961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:32.598276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.599753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.617579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 174/355] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.617579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.673868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a11e-59b1-4d09-90f3-b2838ad770a5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.709426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:32.716812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f3542-9fed-49de-80a1-000948d5639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.717457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f3542-9fed-49de-80a1-000948d5639a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.717746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f3542-9fed-49de-80a1-000948d5639a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.718022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f3542-9fed-49de-80a1-000948d5639a None admin] PATH_INFO: `/v3/users/250fe7fe497e46ffba1c7547356b3952` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.719147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f3542-9fed-49de-80a1-000948d5639a None admin] RBAC: Authorizing `identity:get_user(user_id=250fe7fe497e46ffba1c7547356b3952)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.720630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f3542-9fed-49de-80a1-000948d5639a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.722371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 182/356] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/users/250fe7fe497e46ffba1c7547356b3952 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.723325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ba13-b686-409c-85b3-137da49eb724 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.723620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ba13-b686-409c-85b3-137da49eb724 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.723906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ba13-b686-409c-85b3-137da49eb724 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.725339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 183/357] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:32.725891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ba13-b686-409c-85b3-137da49eb724 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.750392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2c11d-1db8-4433-9227-84de0877bc63 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.795938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.796585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.796858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.797128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.798261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.800177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.801591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 175/358] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.802196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.834592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:32.852619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ba13-b686-409c-85b3-137da49eb724 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.898018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b255b17-a04a-45d3-8048-f468b4384d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.898932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b255b17-a04a-45d3-8048-f468b4384d66 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.899211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b255b17-a04a-45d3-8048-f468b4384d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.899490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b255b17-a04a-45d3-8048-f468b4384d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.900307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b255b17-a04a-45d3-8048-f468b4384d66 None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=916c024b775b4858ba18c731196163a6, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:32.900623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b255b17-a04a-45d3-8048-f468b4384d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:32.902768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b255b17-a04a-45d3-8048-f468b4384d66 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:32.908521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 184/359] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=916c024b775b4858ba18c731196163a6 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:32.909937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16288dee-0953-42e0-898e-a281011d573b None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.910048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16288dee-0953-42e0-898e-a281011d573b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.910259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16288dee-0953-42e0-898e-a281011d573b None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:32.911645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 185/360] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:32.915747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16288dee-0953-42e0-898e-a281011d573b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:32.933992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af52af-77bb-40cb-9b93-59654f71749c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:32.975664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:32.976018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:32.976182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:32.976457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.014020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:33.070208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:33.071907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:33.084304 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16288dee-0953-42e0-898e-a281011d573b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:33.107971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:33.130390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067e17-3c2e-4e3c-a9c0-d2437733607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:33.131185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067e17-3c2e-4e3c-a9c0-d2437733607e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.131637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067e17-3c2e-4e3c-a9c0-d2437733607e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.132055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067e17-3c2e-4e3c-a9c0-d2437733607e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.132946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067e17-3c2e-4e3c-a9c0-d2437733607e None admin] RBAC: Adding query filter params (role.id=c40981e1b3ca4fcbaeba6a24898fc8b2, user.id=250fe7fe497e46ffba1c7547356b3952, scope.system=all) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:33.133401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067e17-3c2e-4e3c-a9c0-d2437733607e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:33.135002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067e17-3c2e-4e3c-a9c0-d2437733607e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:33.150531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 186/361] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/role_assignments?user.id=250fe7fe497e46ffba1c7547356b3952&scope.system=all&role.id=c40981e1b3ca4fcbaeba6a24898fc8b2 => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:33.152818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8485ed-84cf-49dc-80c3-cb79e1b79b56 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.153308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8485ed-84cf-49dc-80c3-cb79e1b79b56 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.153789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8485ed-84cf-49dc-80c3-cb79e1b79b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.176569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-8f8485ed-84cf-49dc-80c3-cb79e1b79b56 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:33.177781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8f8485ed-84cf-49dc-80c3-cb79e1b79b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:33.218614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 176/362] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:33.219983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:33.265224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 187/363] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:33.270342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c992-a627-47a1-b195-968a3b56175f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.270342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c992-a627-47a1-b195-968a3b56175f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.270342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c992-a627-47a1-b195-968a3b56175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.298593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ba79c992-a627-47a1-b195-968a3b56175f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:33.300658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ba79c992-a627-47a1-b195-968a3b56175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:33.381973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:33.391357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a1be2-35a7-4f51-8223-695cb6c5c5de None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:33.414499 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 188/364] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:33.415614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c992-a627-47a1-b195-968a3b56175f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:33.424353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:33.442101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:33.442801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.443089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.443362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.444310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:33.444627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:33.446927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:33.461171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 177/365] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:33 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=6491db22b7294223a5a590b58c543f4c => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:33.543983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c992-a627-47a1-b195-968a3b56175f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:33.584811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:33.585457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.585736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.586010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.587141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:33.588626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:33.590971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 189/366] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:33 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:33.596928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:33.645073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:33.707928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:33.728991 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cb79d-af04-4418-9257-97784a26b74a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:33.768491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c7ed-38a6-4150-82d2-1e2abeb46c2c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:33.777903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:33.779263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.779547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.779853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.781947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:33.783950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:33.786343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 178/367] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:33 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:33.791806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:33.826336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:33.826907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.827188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.827462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.841291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:33.848728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:33.849644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:33.850433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 190/368] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:33.851086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:33.877421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:33.928690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc6aaa-f6e9-493f-9dae-0cbe735354b1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:33.960575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8dd8e-8eb4-4847-a871-f987a9dd7cbf None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:33.968716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:33.969702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:33.970178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:33.970673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:33.971207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:33.984603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:33.992135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:33.993023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:33.993796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:33.996965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 179/369] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:33.998345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:33.999805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.000419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.000697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.000971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.001922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=d9b859fb448947c18435e17df26ae36e) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:34.002240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.003722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.009664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 191/370] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:33 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=6491db22b7294223a5a590b58c543f4c => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:34.010317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:34.120810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cc2b4-1211-4203-9ea3-c444614fcf4e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:34.145391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:34.162279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.163206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.163608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.164006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.164801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:34.165266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.166841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.178179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 180/371] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:34.184251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b14a8-2942-4fd7-a86c-b4eb785ceb7c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:34.186980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:34.246136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.246775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.247055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.247329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.248060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:34.248364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.249806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.275053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 192/372] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:34.281025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:34.358283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7dccc-608b-4fc4-aa42-0c4c0c8582f6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:34.366272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:34.395263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.395910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.396107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.396379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.462303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010210b6-97a2-495e-9ccb-7e0bb4798cd0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:34.474153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:34.499755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.501450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.513462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.514297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.514761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.515242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.601461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.604081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.613775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 181/373] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:34.621235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:34.647236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:34.708146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:34.721421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 193/374] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 10:25:34.726652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:34.730515 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6636a8f-8e83-4e47-84a3-dd03831b2437 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:34.772857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.773491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.773772 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.774047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.775179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.777017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.778959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 182/375] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:34.797085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:34.849937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258702ae-b756-40e3-a807-e987636d4b56 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:34.891073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.891759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.892044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.892325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] PATH_INFO: `/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.893488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5319c7dfcf94967b47c42ebfecd5d8f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.894962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.899757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 194/376] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:34.902680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:34.910000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:34.933643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3562622-9292-48b2-9d92-e1d5988b1cbf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:34.974011 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:34.974645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:34.974926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:34.975197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:34.976519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:34.977962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:34.982179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 183/377] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:34.989876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:35.037644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:35.118916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cd49-00eb-4205-85cf-23d976a3d0b9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:35.170362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee992b22-4892-4506-bd5e-c1f18f73a33c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:35.207351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b1bdb-38e5-495f-90e1-392b84ab1fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:35.208412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b1bdb-38e5-495f-90e1-392b84ab1fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:35.208894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b1bdb-38e5-495f-90e1-392b84ab1fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:35.209374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b1bdb-38e5-495f-90e1-392b84ab1fa8 None admin] PATH_INFO: `/v3/groups/10d62ae50e4b486c92f1cc62b259df9f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:35.213270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:35.214603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:35.214938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:35.215205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:35.215971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=916c024b775b4858ba18c731196163a6, scope.project.id=d9b859fb448947c18435e17df26ae36e) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:35.216302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:35.220747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:35.224670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b1bdb-38e5-495f-90e1-392b84ab1fa8 None admin] RBAC: Authorizing `identity:get_group(group_id=10d62ae50e4b486c92f1cc62b259df9f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:35.226395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b1bdb-38e5-495f-90e1-392b84ab1fa8 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:35.227093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 184/378] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=916c024b775b4858ba18c731196163a6 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:35.233004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 195/379] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:34 2022] GET /identity/v3/groups/10d62ae50e4b486c92f1cc62b259df9f => generated 229 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:35.238825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:35.337639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:35.364759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6170a-510f-4f2f-9327-98a23fabf305 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:35.407110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec2d00-776d-4a13-9594-99a39050a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:35.407748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec2d00-776d-4a13-9594-99a39050a08e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:35.408039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec2d00-776d-4a13-9594-99a39050a08e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:35.408319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec2d00-776d-4a13-9594-99a39050a08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:35.409127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec2d00-776d-4a13-9594-99a39050a08e None admin] RBAC: Adding query filter params (group.id=10d62ae50e4b486c92f1cc62b259df9f, role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=d5319c7dfcf94967b47c42ebfecd5d8f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:35.409446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec2d00-776d-4a13-9594-99a39050a08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:35.410910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec2d00-776d-4a13-9594-99a39050a08e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:35.421711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 185/380] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:35 2022] GET /identity/v3/role_assignments?group.id=10d62ae50e4b486c92f1cc62b259df9f&scope.project.id=d5319c7dfcf94967b47c42ebfecd5d8f&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:35.610225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c38c7-c643-47fa-bc11-2e8b56578518 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:35.610714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c38c7-c643-47fa-bc11-2e8b56578518 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:35.610789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c38c7-c643-47fa-bc11-2e8b56578518 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:35.612421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 196/381] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:35.618393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b373a-e9fc-4a28-85cc-3099cbe54979 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:35.618684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b373a-e9fc-4a28-85cc-3099cbe54979 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:35.618967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b373a-e9fc-4a28-85cc-3099cbe54979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:35.639865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-846b373a-e9fc-4a28-85cc-3099cbe54979 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:35.641077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-846b373a-e9fc-4a28-85cc-3099cbe54979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:35.724978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 186/382] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:36.017602 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631edc2-3cb7-45b3-af45-e583fde5d4d8 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.017976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631edc2-3cb7-45b3-af45-e583fde5d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.018154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631edc2-3cb7-45b3-af45-e583fde5d4d8 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.019633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 197/383] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:36.025015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e48bc-3957-44bf-b9d7-c38b3ed10fef None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.025303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e48bc-3957-44bf-b9d7-c38b3ed10fef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.025582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e48bc-3957-44bf-b9d7-c38b3ed10fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.045024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-901e48bc-3957-44bf-b9d7-c38b3ed10fef None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:36.046210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-901e48bc-3957-44bf-b9d7-c38b3ed10fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:36.129762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 187/384] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:36.205354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631edc2-3cb7-45b3-af45-e583fde5d4d8 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:36.288558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:36.336870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631edc2-3cb7-45b3-af45-e583fde5d4d8 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:36.377489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:36.378113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.378399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.378677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.389911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:36.399517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:36.400446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:36.401863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 198/385] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:36.407345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e48bc-3957-44bf-b9d7-c38b3ed10fef None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:36.420277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:36.571367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e48bc-3957-44bf-b9d7-c38b3ed10fef None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:36.576017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:36.634491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:36.635116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.635397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.636254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.636938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:36.637243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:36.638618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:36.658202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 188/386] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:36.664624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:36.754685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8a87b-f03c-46a0-85c5-8e2d1b16c6b5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:36.792645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:36.809504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:36.823115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c94bcf-3c27-411b-be79-d8db82982c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:36.823771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94bcf-3c27-411b-be79-d8db82982c80 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.824152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94bcf-3c27-411b-be79-d8db82982c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.824432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94bcf-3c27-411b-be79-d8db82982c80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.840112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94bcf-3c27-411b-be79-d8db82982c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:36.844026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff78f-1d81-45f3-87e4-cb43c7fcb105 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-b1c94bcf-3c27-411b-be79-d8db82982c80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:36.845684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:36.846685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:36.847526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 199/387] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:36.848736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023b627-667f-49e4-91c3-fc14d85af2c3 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.848736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023b627-667f-49e4-91c3-fc14d85af2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.848897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023b627-667f-49e4-91c3-fc14d85af2c3 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.859125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 200/388] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:36.859125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023b627-667f-49e4-91c3-fc14d85af2c3 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:36.895203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515e2ce-d13b-4177-adca-2934724af827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:36.895988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e2ce-d13b-4177-adca-2934724af827 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.896273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e2ce-d13b-4177-adca-2934724af827 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.896549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e2ce-d13b-4177-adca-2934724af827 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.897731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515e2ce-d13b-4177-adca-2934724af827 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:36.899344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515e2ce-d13b-4177-adca-2934724af827 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:36.902860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 189/389] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:36 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:36.904102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ac7c-8aba-45f0-a971-97823ee86f71 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:36.904389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ac7c-8aba-45f0-a971-97823ee86f71 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:36.904665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0ac7c-8aba-45f0-a971-97823ee86f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:36.926955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4bf0ac7c-8aba-45f0-a971-97823ee86f71 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:36.928567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4bf0ac7c-8aba-45f0-a971-97823ee86f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:37.012970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023b627-667f-49e4-91c3-fc14d85af2c3 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.013578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 190/390] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:37.014417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0ac7c-8aba-45f0-a971-97823ee86f71 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.061144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.062074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.062527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.062979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.064131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:37.064441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.065823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:37.078590 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 201/391] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:37.084302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.113308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:37.180411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0ac7c-8aba-45f0-a971-97823ee86f71 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.184046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:37.252338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.253000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.253285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.253562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.254747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.256244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:37.258180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 191/392] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:37 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:37.264845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.270971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05fa79-6760-4acb-95ac-07c09561e8e6 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.333662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.334520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.334960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.335376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.336684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.339406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:37.342427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 202/393] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:37 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:37.343458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.423150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158cf7-06c6-4ab3-bb45-e13f6dff03bb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.460560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:37.471100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.472044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.472478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.472893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/groups/bf96e3027388486faa7c6299b9c70b4a/roles/916c024b775b4858ba18c731196163a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.474217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9278-4e9b-436e-a111-6bdf11552dc9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.475404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=275ef91a40de4500ace5dd380f4f1ffe, group_id=bf96e3027388486faa7c6299b9c70b4a, role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.477152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:37.493543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 192/394] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Sep 5 10:25:37 2022] PUT /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/groups/bf96e3027388486faa7c6299b9c70b4a/roles/916c024b775b4858ba18c731196163a6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:25:37.494508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:37.496253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.534764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.535434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.535744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.536018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.555019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:37.566996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:37.568028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:37.568839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 203/395] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:37.574864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.624929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339b844-d609-4258-ac56-e98b6df1f4c6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.665081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.666283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.667332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.668182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.670480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.672265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:37.674647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 193/396] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:37 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:37.680373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.719424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af248a13-8616-4da1-b98c-d6abb1c6e36b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.757295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.757915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.758168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.758438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.759135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] RBAC: Adding query filter params (name=member) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:37.759815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.759975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:37.761595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:37.770867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 204/397] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:37.780703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:37.798771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a166-aa35-4eaa-91f4-577f78fcce81 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.828455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:37.842845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5013a-957c-4200-9d4f-1ae36650dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.844027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5013a-957c-4200-9d4f-1ae36650dd4a None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.844911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5013a-957c-4200-9d4f-1ae36650dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.845654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5013a-957c-4200-9d4f-1ae36650dd4a None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/groups/bf96e3027388486faa7c6299b9c70b4a/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.848840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5013a-957c-4200-9d4f-1ae36650dd4a None admin] RBAC: Authorizing `identity:create_grant(project_id=275ef91a40de4500ace5dd380f4f1ffe, group_id=bf96e3027388486faa7c6299b9c70b4a, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.852412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5013a-957c-4200-9d4f-1ae36650dd4a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:37.876332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 194/398] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Sep 5 10:25:37 2022] PUT /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe/groups/bf96e3027388486faa7c6299b9c70b4a/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:37.921344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1315-917d-4a7c-921a-4499afdfef3b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.921691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1315-917d-4a7c-921a-4499afdfef3b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.921967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1315-917d-4a7c-921a-4499afdfef3b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.923482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 195/399] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:37.924419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000165-9623-4e23-b1ae-b4c3f913cb1b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.924789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000165-9623-4e23-b1ae-b4c3f913cb1b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.925059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000165-9623-4e23-b1ae-b4c3f913cb1b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.926388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 196/400] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:37.933349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f24e-6d8e-43eb-b946-669642dbf991 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.933676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f24e-6d8e-43eb-b946-669642dbf991 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.934065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f24e-6d8e-43eb-b946-669642dbf991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.936529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262aa5d6-2aaf-469e-adf6-7ce4b3c57ddd None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:37.954497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-66b9f24e-6d8e-43eb-b946-669642dbf991 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:37.955797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66b9f24e-6d8e-43eb-b946-669642dbf991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:37.991849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7a443-b956-4d54-b5c7-a1bb22b086d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:37.993274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7a443-b956-4d54-b5c7-a1bb22b086d5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:37.993827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7a443-b956-4d54-b5c7-a1bb22b086d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:37.994282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7a443-b956-4d54-b5c7-a1bb22b086d5 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:37.996641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7a443-b956-4d54-b5c7-a1bb22b086d5 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:37.998757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7a443-b956-4d54-b5c7-a1bb22b086d5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:38.001545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 205/401] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:37 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:38.006609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ac899-b76d-4004-b536-5f20607689f9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:38.006897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ac899-b76d-4004-b536-5f20607689f9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:38.007171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ac899-b76d-4004-b536-5f20607689f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:38.026617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f43ac899-b76d-4004-b536-5f20607689f9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:38.027971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f43ac899-b76d-4004-b536-5f20607689f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:38.047680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 197/402] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:38.048604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f24e-6d8e-43eb-b946-669642dbf991 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:38.108261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:38.142242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 206/403] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:38.175320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f24e-6d8e-43eb-b946-669642dbf991 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:38.219047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:38.220055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:38.220581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:38.221079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:38.222393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:38.224136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:38.226029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 198/404] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:38 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:38.232796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ac899-b76d-4004-b536-5f20607689f9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:38.279826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:38.364985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:38.382579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ac899-b76d-4004-b536-5f20607689f9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:38.454777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:38.455455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:38.455758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:38.456032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e/groups/bf96e3027388486faa7c6299b9c70b4a/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:38.458021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b859fb448947c18435e17df26ae36e, group_id=bf96e3027388486faa7c6299b9c70b4a, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:38.459462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:38.487636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 207/405] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Sep 5 10:25:38 2022] PUT /identity/v3/projects/d9b859fb448947c18435e17df26ae36e/groups/bf96e3027388486faa7c6299b9c70b4a/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:38.518100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273f323-b0a3-4054-b82e-7637519d7a4e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:38.547532 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:38.554440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:38.564040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:38.564780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:38.565064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:38.565336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:38.590359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:38.599204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:38.600214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:38.601018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:38.601803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 199/406] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:38.609277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:38.708091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:38.720299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831026cd-8b3c-48d7-948e-3051dc72c118 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:38.757184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc1f75-5cc4-4a48-9b65-06576486f863 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:38.766947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:38.767630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:38.767913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:38.768191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:38.782221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:38.797104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:38.798136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:38.798929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 208/407] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:38.809553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:38.809832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:38.810237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:38.810526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:38.810799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:38.811474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:38.811829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:38.813653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:38.832641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 200/408] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:38.837175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:38.921724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:38.974892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca845d-8b2b-4309-b48e-2a2c6136a490 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:39.011718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7410-f0e0-49aa-8382-bb0ed997a15e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:39.016446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:39.017940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:39.018236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:39.018514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:39.019192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:39.019499 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:39.020943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:39.047774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 209/409] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:39.055136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:39.078952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:39.079894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:39.080198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:39.080486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:39.081619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:39.083130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:39.089570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 201/410] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:38 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:39.092788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:39.095038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:39.258732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c47e1-cdf3-4c54-8b16-9b21ac73c311 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:39.263114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b80b-a816-46b2-84e0-9dcf916f0307 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:39.283939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:39.312448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:39.313096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:39.313379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:39.313655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] PATH_INFO: `/v3/groups/10d62ae50e4b486c92f1cc62b259df9f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:39.315165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] RBAC: Authorizing `identity:get_group(group_id=10d62ae50e4b486c92f1cc62b259df9f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:39.316971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:39.319199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 210/411] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:39 2022] GET /identity/v3/groups/10d62ae50e4b486c92f1cc62b259df9f => generated 229 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:39.322518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:39.324070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:39.324539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:39.325020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:39.325732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:39.326627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:39.328294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:39.330385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 202/412] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:39 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:39.336242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:39.459475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:39.476285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32e2ba-2fc7-40da-ba28-9a0dc304c6e1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:39.519788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:39.520750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:39.521275 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:39.521751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] PATH_INFO: `/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:39.524680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] RBAC: Authorizing `identity:get_project(project_id=d5319c7dfcf94967b47c42ebfecd5d8f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:39.526920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:39.530742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 211/413] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:39 2022] GET /identity/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:39.535082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9680594-97c1-44e5-ae54-7b276afa16d7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:39.536447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:39.606608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd629e-c231-4c49-946f-11302baef67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:39.607670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd629e-c231-4c49-946f-11302baef67b None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:39.608194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd629e-c231-4c49-946f-11302baef67b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:39.612897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd629e-c231-4c49-946f-11302baef67b None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e/groups/bf96e3027388486faa7c6299b9c70b4a/roles/916c024b775b4858ba18c731196163a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:39.616986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd629e-c231-4c49-946f-11302baef67b None admin] RBAC: Authorizing `identity:create_grant(project_id=d9b859fb448947c18435e17df26ae36e, group_id=bf96e3027388486faa7c6299b9c70b4a, role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:39.618681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd629e-c231-4c49-946f-11302baef67b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:39.640967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 203/414] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Sep 5 10:25:39 2022] PUT /identity/v3/projects/d9b859fb448947c18435e17df26ae36e/groups/bf96e3027388486faa7c6299b9c70b4a/roles/916c024b775b4858ba18c731196163a6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:39.704370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37471031-b53a-4d68-8216-d0609477fd26 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:39.754436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e8b15-1a95-4863-b0f2-cb8051561ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:39.755505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8b15-1a95-4863-b0f2-cb8051561ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:39.756077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8b15-1a95-4863-b0f2-cb8051561ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:39.756575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e8b15-1a95-4863-b0f2-cb8051561ea4 None admin] PATH_INFO: `/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f/groups/10d62ae50e4b486c92f1cc62b259df9f/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:39.758892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e8b15-1a95-4863-b0f2-cb8051561ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5319c7dfcf94967b47c42ebfecd5d8f, group_id=10d62ae50e4b486c92f1cc62b259df9f, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:39.761257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e8b15-1a95-4863-b0f2-cb8051561ea4 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:39.782371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 212/415] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Sep 5 10:25:39 2022] PUT /identity/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f/groups/10d62ae50e4b486c92f1cc62b259df9f/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:25:40.021463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233bc-9c9a-4de7-99f7-2c7b9f46e7e7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.022118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233bc-9c9a-4de7-99f7-2c7b9f46e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.022630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba233bc-9c9a-4de7-99f7-2c7b9f46e7e7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.024549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 204/416] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:40.030549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666bea-a2f5-4e5c-b2c0-143e9665566c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.031100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666bea-a2f5-4e5c-b2c0-143e9665566c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.031628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666bea-a2f5-4e5c-b2c0-143e9665566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.050689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-39666bea-a2f5-4e5c-b2c0-143e9665566c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:40.052234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-39666bea-a2f5-4e5c-b2c0-143e9665566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:40.062621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:40.131644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 213/417] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:40.224031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f4cee-5b8d-4d9e-a5b3-648a03c8a7e0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.224683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f4cee-5b8d-4d9e-a5b3-648a03c8a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.225181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f4cee-5b8d-4d9e-a5b3-648a03c8a7e0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.226749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 205/418] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:40.244566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d310d-c5a2-4064-bbcf-b3b82e80b9eb None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.245323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d310d-c5a2-4064-bbcf-b3b82e80b9eb None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.246116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d310d-c5a2-4064-bbcf-b3b82e80b9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.273257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0f5d310d-c5a2-4064-bbcf-b3b82e80b9eb None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:40.274801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0f5d310d-c5a2-4064-bbcf-b3b82e80b9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:40.363974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 214/419] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:40.536401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f4cee-5b8d-4d9e-a5b3-648a03c8a7e0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:40.587494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:40.672673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f4cee-5b8d-4d9e-a5b3-648a03c8a7e0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:40.717983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:40.718914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.719399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.719985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.730573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:40.735736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:40.736624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:40.737420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:40.739962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 206/420] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:40.747676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d310d-c5a2-4064-bbcf-b3b82e80b9eb None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:40.778766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:40.853886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:40.882498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d310d-c5a2-4064-bbcf-b3b82e80b9eb None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:40.913177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:40.921550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f633d-447b-4814-922e-ea09c907bc17 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:40.922157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8a55f-bcfc-499f-acc1-b2b463ce8e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:40.922937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a55f-bcfc-499f-acc1-b2b463ce8e59 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.923265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a55f-bcfc-499f-acc1-b2b463ce8e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.923810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a55f-bcfc-499f-acc1-b2b463ce8e59 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.924544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a55f-bcfc-499f-acc1-b2b463ce8e59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:40.925614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a55f-bcfc-499f-acc1-b2b463ce8e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:40.926540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a55f-bcfc-499f-acc1-b2b463ce8e59 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:40.937540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 215/421] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:40.938946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717e1d8-16c5-419e-ab20-f6f2b5fa216c None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.939350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717e1d8-16c5-419e-ab20-f6f2b5fa216c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.939874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717e1d8-16c5-419e-ab20-f6f2b5fa216c None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.945467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 216/422] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:40.945467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717e1d8-16c5-419e-ab20-f6f2b5fa216c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:40.976134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0925805-c0e5-4e4f-857e-3e098b0c8f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:40.977034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0925805-c0e5-4e4f-857e-3e098b0c8f83 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:40.977323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0925805-c0e5-4e4f-857e-3e098b0c8f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:40.977600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0925805-c0e5-4e4f-857e-3e098b0c8f83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:40.992285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0925805-c0e5-4e4f-857e-3e098b0c8f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c0925805-c0e5-4e4f-857e-3e098b0c8f83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:40.999046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:41.000012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:41.000824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 207/423] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:41.001738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc1d1-665d-4b95-9657-614ab49da04e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.002022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc1d1-665d-4b95-9657-614ab49da04e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.002323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc1d1-665d-4b95-9657-614ab49da04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.028031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fc1dc1d1-665d-4b95-9657-614ab49da04e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:41.029504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc1dc1d1-665d-4b95-9657-614ab49da04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:41.070851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717e1d8-16c5-419e-ab20-f6f2b5fa216c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:41.113133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 208/424] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:41.114501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dc1d1-665d-4b95-9657-614ab49da04e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:41.119612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:41.119612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.119612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.119612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.121851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:41.198199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:41.199809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:41.303308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:41.319720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dc1d1-665d-4b95-9657-614ab49da04e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:41.326066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 217/425] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:41.333226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:41.375064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:41.386219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:41.386963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.387350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.387820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.388660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:41.389070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:41.390550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:41.409551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 209/426] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:41.414739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:41.475865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100f57c-d65f-4613-847d-88e27517c6de None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:41.525337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:41.526775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.527071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.527356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.529213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:41.530576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee250455-f2a3-47e9-bd98-1f6d7b2697ab None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:41.530705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:41.533881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 218/427] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:41 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:41.534682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:41.568439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:41.569054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.569342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.569624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.590591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:41.659881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:41.661914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:41.676489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1da6fe-da72-450f-92ff-62422b38a2f0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:41.680825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:41.737056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:41.737643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.738261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.738544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.753872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:41.760227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:41.761801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 219/428] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:41.767628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:41.806051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 210/429] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:41.808013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:41.877626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:41.892451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04640464-fd7b-40e3-88a9-e1ea0e3def8f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:41.931419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:41.931987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.932364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.932643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.933858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:41.935822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:41.942242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 220/430] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:41 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:41.943118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:41.951476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272aaf4-2518-4c6e-92bb-23594a28dd49 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:41.977755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:41.988564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:41.989111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:41.989388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:41.989661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:41.990329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] RBAC: Adding query filter params (name=member) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:41.990623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:41.992025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.000647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 211/431] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:25:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:42.005318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.059349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa8d2f-5a12-476f-b4e0-d519faa8ea25 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.098484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7085e5-4df1-4cf8-b04a-84343c98d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.099110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7085e5-4df1-4cf8-b04a-84343c98d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.099402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7085e5-4df1-4cf8-b04a-84343c98d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.099677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7085e5-4df1-4cf8-b04a-84343c98d5fd None admin] PATH_INFO: `/v3/projects/275ef91a40de4500ace5dd380f4f1ffe` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.100792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7085e5-4df1-4cf8-b04a-84343c98d5fd None admin] RBAC: Authorizing `identity:get_project(project_id=275ef91a40de4500ace5dd380f4f1ffe)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:42.102277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7085e5-4df1-4cf8-b04a-84343c98d5fd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.103902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 221/432] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:41 2022] GET /identity/v3/projects/275ef91a40de4500ace5dd380f4f1ffe => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:42.106091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d72e19-2e75-4080-90c0-a65ae277be30 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.106366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d72e19-2e75-4080-90c0-a65ae277be30 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.106637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d72e19-2e75-4080-90c0-a65ae277be30 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.107851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 222/433] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:42.108534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d72e19-2e75-4080-90c0-a65ae277be30 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.114031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05b867-fc3f-4511-a92f-f93ab2dce023 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.125291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:42.150850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57fe0d-32e1-4ae1-920b-d4c78fd07085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.152292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57fe0d-32e1-4ae1-920b-d4c78fd07085 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.152709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57fe0d-32e1-4ae1-920b-d4c78fd07085 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.152990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57fe0d-32e1-4ae1-920b-d4c78fd07085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.153710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57fe0d-32e1-4ae1-920b-d4c78fd07085 None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=916c024b775b4858ba18c731196163a6, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:42.154019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57fe0d-32e1-4ae1-920b-d4c78fd07085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:42.155461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57fe0d-32e1-4ae1-920b-d4c78fd07085 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.161254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 212/434] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=916c024b775b4858ba18c731196163a6 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:42.162452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b8b7-1b76-4807-857d-55c6d0cc23fb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.162740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b8b7-1b76-4807-857d-55c6d0cc23fb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.163019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b8b7-1b76-4807-857d-55c6d0cc23fb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.164491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 213/435] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:42.165041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b8b7-1b76-4807-857d-55c6d0cc23fb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.224330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:42.229595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d72e19-2e75-4080-90c0-a65ae277be30 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.269499 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.270125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.270406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.270673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.289478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b8b7-1b76-4807-857d-55c6d0cc23fb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.337112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24520b7b-0216-4b8b-8d16-30af6101ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.337750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24520b7b-0216-4b8b-8d16-30af6101ef98 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.338032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24520b7b-0216-4b8b-8d16-30af6101ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.339543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24520b7b-0216-4b8b-8d16-30af6101ef98 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.340959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24520b7b-0216-4b8b-8d16-30af6101ef98 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:42.343189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24520b7b-0216-4b8b-8d16-30af6101ef98 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.344172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 214/436] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:42.349056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f313cdc-11b2-4341-8def-011915b13e4b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.349513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f313cdc-11b2-4341-8def-011915b13e4b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.349933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f313cdc-11b2-4341-8def-011915b13e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.350829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:42.352344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.368897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0f313cdc-11b2-4341-8def-011915b13e4b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:42.370167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0f313cdc-11b2-4341-8def-011915b13e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:42.407501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:42.440375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 215/437] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:42.441619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822b96-0542-4f00-8d06-90f794b68f6b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.441907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822b96-0542-4f00-8d06-90f794b68f6b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.442185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb822b96-0542-4f00-8d06-90f794b68f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.466114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:42.470695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 223/438] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:42.471510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bb822b96-0542-4f00-8d06-90f794b68f6b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:42.471701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.472998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bb822b96-0542-4f00-8d06-90f794b68f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:42.546745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 216/439] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:42.547891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822b96-0542-4f00-8d06-90f794b68f6b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.584211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b379ccd-7c16-44e3-8282-3d793904fffd None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.630033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.631009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.631385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.631900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.633026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=275ef91a40de4500ace5dd380f4f1ffe) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:42.633477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:42.635055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.643754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 224/440] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=275ef91a40de4500ace5dd380f4f1ffe&role.id=6491db22b7294223a5a590b58c543f4c => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:42.684755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb822b96-0542-4f00-8d06-90f794b68f6b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.687583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:42.713264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.731336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.732184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.732595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.732872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.734874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:42.736364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.739046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 217/441] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:42.744341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.790321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:42.833242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b736140-f67f-446d-98ee-a4c5cf762f78 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.871503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.872559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.872866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.873150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.875830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa874-dccf-44d8-9eae-28a6ceeeacf2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:42.887538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:42.893404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:42.894725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 225/442] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:42.895527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.921218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:42.921922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:42.922208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:42.922480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:42.923746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:42.925087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:42.926664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 218/443] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:42.928367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:42.978907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.016271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b3c0b-7837-412f-941c-2c0504ab748c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.043007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.057122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.058345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.058636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.058914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.061340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da65b-7e30-4421-8777-3e5a47f6fd6e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.071063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:43.077214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:43.078212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 226/444] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:43.080533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.108185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.108721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.109012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.109289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.110301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:43.110301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.111710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.122956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 219/445] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:43.123546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.208244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050e271-195c-4db8-ad30-adc082e14a7b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.237315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.240448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c655a4-45f9-4f27-94bc-9944076fdc45 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.242475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.243089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.243368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.243690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.244421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=6491db22b7294223a5a590b58c543f4c, scope.project.id=d9b859fb448947c18435e17df26ae36e) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:43.245421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.247191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.253116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 227/446] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=6491db22b7294223a5a590b58c543f4c => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:43.253887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.280480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.281111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.281414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.281694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.282387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:43.282702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.284212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.298415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 220/447] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:43.299649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.316719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.378508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db935e-0c1e-4bf4-942a-2f8e6ef3faf9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.415685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e8f0e-6c97-485e-8f1a-d10745f6719f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.425460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.425460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.425802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.425977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.460626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.461244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.461528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.461804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.500270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.511314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.512942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.542877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.544498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.571676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.633891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 228/448] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:43.640072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.660486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 221/449] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:43.666251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.726151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.739167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d99d5-4dee-49be-9204-adbc1430c60e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.767319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3dae2-a258-49b8-a9cf-1e76613404b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.774439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.775059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.775335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.775646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] PATH_INFO: `/v3/projects/d9b859fb448947c18435e17df26ae36e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.777043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] RBAC: Authorizing `identity:get_project(project_id=d9b859fb448947c18435e17df26ae36e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.778476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.780261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 229/450] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/projects/d9b859fb448947c18435e17df26ae36e => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:43.785632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.803334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.806162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.806792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.807075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.808087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] PATH_INFO: `/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.809229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] RBAC: Authorizing `identity:get_project(project_id=d5319c7dfcf94967b47c42ebfecd5d8f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.810760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.812323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 222/451] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/projects/d5319c7dfcf94967b47c42ebfecd5d8f => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:43.817596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.886199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca8003-b20a-4938-a7da-93a17e06310c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.916136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba783-f0bb-47ce-aa65-d940617ffd73 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:43.920729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.921385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.921667 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.921945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] PATH_INFO: `/v3/groups/bf96e3027388486faa7c6299b9c70b4a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.923065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] RBAC: Authorizing `identity:get_group(group_id=bf96e3027388486faa7c6299b9c70b4a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.924557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.926115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 230/452] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/groups/bf96e3027388486faa7c6299b9c70b4a => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:43.931828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:43.943997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:43.951040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:43.951695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:43.951985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:43.952264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] PATH_INFO: `/v3/groups/10d62ae50e4b486c92f1cc62b259df9f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:43.953374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] RBAC: Authorizing `identity:get_group(group_id=10d62ae50e4b486c92f1cc62b259df9f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:43.954821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:43.956583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 223/453] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/groups/10d62ae50e4b486c92f1cc62b259df9f => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:43.962087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:44.016308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:44.033141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066ad01-7f5f-46e3-9748-2af609eaa716 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:44.061835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ca430-950b-4fa7-b414-acd8efb135b5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:44.066157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd84e37-2bd6-4207-bb55-a37eff9a3e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:44.066754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84e37-2bd6-4207-bb55-a37eff9a3e96 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:44.067035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84e37-2bd6-4207-bb55-a37eff9a3e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:44.067307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd84e37-2bd6-4207-bb55-a37eff9a3e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:44.068060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd84e37-2bd6-4207-bb55-a37eff9a3e96 None admin] RBAC: Adding query filter params (group.id=bf96e3027388486faa7c6299b9c70b4a, role.id=916c024b775b4858ba18c731196163a6, scope.project.id=d9b859fb448947c18435e17df26ae36e) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:44.068365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd84e37-2bd6-4207-bb55-a37eff9a3e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:44.069799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd84e37-2bd6-4207-bb55-a37eff9a3e96 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:44.076356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 231/454] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/role_assignments?group.id=bf96e3027388486faa7c6299b9c70b4a&scope.project.id=d9b859fb448947c18435e17df26ae36e&role.id=916c024b775b4858ba18c731196163a6 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:44.099695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b7283-4f82-4559-bff6-90a6b992ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:44.100324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7283-4f82-4559-bff6-90a6b992ff04 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:44.100608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7283-4f82-4559-bff6-90a6b992ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:44.100885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7283-4f82-4559-bff6-90a6b992ff04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:44.101642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b7283-4f82-4559-bff6-90a6b992ff04 None admin] RBAC: Adding query filter params (group.id=10d62ae50e4b486c92f1cc62b259df9f, role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=d5319c7dfcf94967b47c42ebfecd5d8f) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:44.101956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b7283-4f82-4559-bff6-90a6b992ff04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:44.103431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b7283-4f82-4559-bff6-90a6b992ff04 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:44.110332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 224/455] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Sep 5 10:25:43 2022] GET /identity/v3/role_assignments?group.id=10d62ae50e4b486c92f1cc62b259df9f&scope.project.id=d5319c7dfcf94967b47c42ebfecd5d8f&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:46.506202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770766f-6f23-426d-9c34-d52771e071be None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:46.506748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770766f-6f23-426d-9c34-d52771e071be None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:46.506748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770766f-6f23-426d-9c34-d52771e071be None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:46.508396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 232/456] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:46.514328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b52d-4613-407d-84f0-fe08c3b88a0a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:46.514787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b52d-4613-407d-84f0-fe08c3b88a0a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:46.514886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b52d-4613-407d-84f0-fe08c3b88a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:46.544589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b765b52d-4613-407d-84f0-fe08c3b88a0a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:46.545795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b765b52d-4613-407d-84f0-fe08c3b88a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:46.627067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:46.638670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 225/457] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:46.674012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4067ec-da48-4695-87bc-ed0c55bcff9e None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:46.674310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4067ec-da48-4695-87bc-ed0c55bcff9e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:46.674570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4067ec-da48-4695-87bc-ed0c55bcff9e None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:46.675958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 233/458] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:46.681246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3f29-0ae9-428b-839f-d58e9dad1a9a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:46.681539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3f29-0ae9-428b-839f-d58e9dad1a9a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:46.681817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3f29-0ae9-428b-839f-d58e9dad1a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:46.706866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-344c3f29-0ae9-428b-839f-d58e9dad1a9a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:46.708078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-344c3f29-0ae9-428b-839f-d58e9dad1a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:46.776520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 226/459] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:46.962392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed4e4-71c2-432c-863d-e8aecac571ab None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:46.962787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed4e4-71c2-432c-863d-e8aecac571ab None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:46.962959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed4e4-71c2-432c-863d-e8aecac571ab None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:46.964780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 234/460] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:46.969769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4e08-71ac-4566-a98a-be5f214c0e34 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:46.970061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4e08-71ac-4566-a98a-be5f214c0e34 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:46.970342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4e08-71ac-4566-a98a-be5f214c0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:46.996811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-707a4e08-71ac-4566-a98a-be5f214c0e34 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:46.998007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-707a4e08-71ac-4566-a98a-be5f214c0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:47.025016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ed4e4-71c2-432c-863d-e8aecac571ab None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.120433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 227/461] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:47.179841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a4e08-71ac-4566-a98a-be5f214c0e34 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.196859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ed4e4-71c2-432c-863d-e8aecac571ab None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.247258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:47.266138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.268321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.268621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.268899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.297381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.298864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.313342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:47.324988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:47.325937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:47.326826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:47.326826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:47.326826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:47.328618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 235/462] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:47.333459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a4e08-71ac-4566-a98a-be5f214c0e34 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.334569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.381034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.381648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.381937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.382214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.398111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.399648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:47.424585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:47.426873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:47.427852 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:47.427852 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:47.427852 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:47.432789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 228/463] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:47.434041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.463015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121f85-e1e0-4566-b568-c541d2d34ab5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.499310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.500227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.500677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.501095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.501877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:47.502422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.504094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.518142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 236/464] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:47.519733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.556609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43e80e-a6f0-4d5a-89f9-342282799fc2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.560203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:47.582890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:47.597962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.598565 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.598844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.599116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.599782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:47.600087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.601611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.618461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 229/465] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:47.618461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.632494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528343-22a5-4a91-a2ad-4f588ba01071 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.673426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964f9d-bee0-4d38-a2d9-228905aafeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.674047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964f9d-bee0-4d38-a2d9-228905aafeee None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.674329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964f9d-bee0-4d38-a2d9-228905aafeee None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.674598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964f9d-bee0-4d38-a2d9-228905aafeee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.685381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97964f9d-bee0-4d38-a2d9-228905aafeee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.686847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97964f9d-bee0-4d38-a2d9-228905aafeee None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-97964f9d-bee0-4d38-a2d9-228905aafeee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:47.702241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:47.703173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:47.704064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:47.704064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:47.704064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:47.704064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 237/466] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:47.705193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6905-3378-492b-84b9-b5b79a6c28b5 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.705193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6905-3378-492b-84b9-b5b79a6c28b5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.705193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6905-3378-492b-84b9-b5b79a6c28b5 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.706502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 238/467] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:47.707744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6905-3378-492b-84b9-b5b79a6c28b5 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.734255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e2be1-3e36-472b-86c2-ce5c2f9c5463 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.773266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.773873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.774161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.774438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.775092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.777208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.799765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 230/468] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:47 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:47.800585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:47.830827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:47.833516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6905-3378-492b-84b9-b5b79a6c28b5 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.860961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:47.893548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eb26f-88fd-42c0-a17f-bef6ecc39eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.894495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eb26f-88fd-42c0-a17f-bef6ecc39eca None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.894949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eb26f-88fd-42c0-a17f-bef6ecc39eca None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.895447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eb26f-88fd-42c0-a17f-bef6ecc39eca None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.896325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eb26f-88fd-42c0-a17f-bef6ecc39eca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.898757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eb26f-88fd-42c0-a17f-bef6ecc39eca None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.927331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc4674-cacd-499b-bd8b-e313e919a4fc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:47.929265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 239/469] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:47 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:47.931892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b174-9287-4044-89a6-bcd8f09552d2 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.932926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b174-9287-4044-89a6-bcd8f09552d2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.933686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b174-9287-4044-89a6-bcd8f09552d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.961355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-acc2b174-9287-4044-89a6-bcd8f09552d2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:47.963561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-acc2b174-9287-4044-89a6-bcd8f09552d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:47.970174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:47.970955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:47.971290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:47.971572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:47.972305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:47.972618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:47.974270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:47.989208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 231/470] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:47.998033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:48.075866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 240/471] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:48.121559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:48.133146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2457-f333-496d-ad96-4f49ed1ace6b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:48.172655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2da6c-4f75-4c59-b711-ea9e17287e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:48.173609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2da6c-4f75-4c59-b711-ea9e17287e7f None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:48.174084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2da6c-4f75-4c59-b711-ea9e17287e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:48.174548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2da6c-4f75-4c59-b711-ea9e17287e7f None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:48.175419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2da6c-4f75-4c59-b711-ea9e17287e7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:48.177157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2da6c-4f75-4c59-b711-ea9e17287e7f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:48.202187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 232/472] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:47 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:48.235180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1fad2-e669-4852-9f02-bc5f18c72d88 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:48.235491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1fad2-e669-4852-9f02-bc5f18c72d88 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:48.235756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1fad2-e669-4852-9f02-bc5f18c72d88 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:48.237311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 241/473] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:25:48.243109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a8292-f258-4ffe-8bf2-d139888084a0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:48.243398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a8292-f258-4ffe-8bf2-d139888084a0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:48.243706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a8292-f258-4ffe-8bf2-d139888084a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:48.268695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8c1a8292-f258-4ffe-8bf2-d139888084a0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:48.269945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c1a8292-f258-4ffe-8bf2-d139888084a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:48.357565 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 233/474] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:25:48.404985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1fad2-e669-4852-9f02-bc5f18c72d88 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:48.515638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:48.521636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1fad2-e669-4852-9f02-bc5f18c72d88 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:48.560413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:48.561042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:48.561322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:48.561591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:48.572291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:48.573862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:48.591454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:48.592485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:48.593362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:48.593362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:48.593362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:48.593362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 242/475] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:48.598866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a8292-f258-4ffe-8bf2-d139888084a0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:48.661538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:48.674539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:48.727611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a8292-f258-4ffe-8bf2-d139888084a0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:48.777538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:48.778526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:48.778954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:48.779739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:48.780835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:48.781290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:48.783306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:48.785967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b173c-f8b5-45ba-983a-625f00cb7d8b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:48.800022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 234/476] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:48.805403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:48.836471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:48.837100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:48.837382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:48.837657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:48.838971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:48.841332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:48.849913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.sql.core [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 10:25:48.849913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 10:25:48.849913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [parameters: {'id': '8dbbde2c9f3b4e27ba440e55dadd0f4d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 10:25:48.849913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81474) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application result.read() Sep 05 10:25:48.868806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return ref.to_dict() Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:25:48.870450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application yield resource Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise self.value Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application session.commit() Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 10:25:48.871665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self.session.flush() Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application compat.raise_( Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 10:25:48.872622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:25:48.874905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application result.read() Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:25:48.876902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [parameters: {'id': '8dbbde2c9f3b4e27ba440e55dadd0f4d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:48.878808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 10:25:48.882877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:48.886851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 243/477] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Sep 5 10:25:48 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:48.886851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:48.896525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:49.005305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33564-2dba-479d-8c56-1e8764457ac3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:49.007843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a245e2-e630-4e1b-a450-6a46dd75a52c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:49.058771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:49.076625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62f7e5-802d-46bd-95fb-fc9dd3c99e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:49.077331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f7e5-802d-46bd-95fb-fc9dd3c99e04 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:49.077617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f7e5-802d-46bd-95fb-fc9dd3c99e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:49.077894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f7e5-802d-46bd-95fb-fc9dd3c99e04 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:49.078569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62f7e5-802d-46bd-95fb-fc9dd3c99e04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:49.082993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62f7e5-802d-46bd-95fb-fc9dd3c99e04 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:49.094779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:49.095411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:49.095718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:49.095998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:49.112905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:49.127407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:49.128401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 10:25:49.129223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:49.130331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 244/478] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:25:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:49.131209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:49.147736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 235/479] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:48 2022] POST /identity/v3/users => generated 249 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:25:49.253217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:49.283364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cffc4-9e58-4042-b4b6-203a238e8628 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:49.326320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446491-ef83-4a75-8552-872fe9fa3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:49.327890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446491-ef83-4a75-8552-872fe9fa3a03 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:49.328680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446491-ef83-4a75-8552-872fe9fa3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:49.329431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446491-ef83-4a75-8552-872fe9fa3a03 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:49.331007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446491-ef83-4a75-8552-872fe9fa3a03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:49.331892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446491-ef83-4a75-8552-872fe9fa3a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:49.335001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446491-ef83-4a75-8552-872fe9fa3a03 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:49.363957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 245/480] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:50.494231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e512a-f9bd-4f19-bea8-512a3f88ab16 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:50.495393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e512a-f9bd-4f19-bea8-512a3f88ab16 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:50.496160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e512a-f9bd-4f19-bea8-512a3f88ab16 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:50.497987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 236/481] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:50.503801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74f398-ea95-43d5-893e-3bcc57978c0d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:50.504629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74f398-ea95-43d5-893e-3bcc57978c0d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:50.505108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74f398-ea95-43d5-893e-3bcc57978c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:50.525263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0e74f398-ea95-43d5-893e-3bcc57978c0d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:50.527398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0e74f398-ea95-43d5-893e-3bcc57978c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:50.603734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 246/482] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:50.623700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a30d-0743-4513-b513-e87508ef71f1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:50.624344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a30d-0743-4513-b513-e87508ef71f1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:50.624824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a30d-0743-4513-b513-e87508ef71f1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:50.626348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 237/483] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:50.633495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9510eb-4cc2-4a06-a871-4a227c6c8fff None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:50.634005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9510eb-4cc2-4a06-a871-4a227c6c8fff None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:50.634541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9510eb-4cc2-4a06-a871-4a227c6c8fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:50.660574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ac9510eb-4cc2-4a06-a871-4a227c6c8fff None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:50.662090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ac9510eb-4cc2-4a06-a871-4a227c6c8fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:50.728029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:50.733490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 247/484] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:50.918552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21a30d-0743-4513-b513-e87508ef71f1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.045444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21a30d-0743-4513-b513-e87508ef71f1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.088896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.088896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.088896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.088896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.106824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:51.111938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:51.112826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:51.113618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 238/485] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:51.118945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9510eb-4cc2-4a06-a871-4a227c6c8fff None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.146140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.219646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:51.281221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9510eb-4cc2-4a06-a871-4a227c6c8fff None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.320963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fbb37-3440-4059-b4c9-a95877aefb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.321689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbb37-3440-4059-b4c9-a95877aefb0e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.322023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbb37-3440-4059-b4c9-a95877aefb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.322397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fbb37-3440-4059-b4c9-a95877aefb0e None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.323156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fbb37-3440-4059-b4c9-a95877aefb0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:51.323468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fbb37-3440-4059-b4c9-a95877aefb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:51.324991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fbb37-3440-4059-b4c9-a95877aefb0e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:51.328254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35efd7d-a52c-4ba4-931c-48254f719b08 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.334058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 248/486] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:51.335253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a3fa-31d2-488d-a36e-15b857e2a4f1 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.335542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a3fa-31d2-488d-a36e-15b857e2a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.335887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a3fa-31d2-488d-a36e-15b857e2a4f1 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.337436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 249/487] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:51.340916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a3fa-31d2-488d-a36e-15b857e2a4f1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.378214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841c31b-96c4-451a-8649-26eb571d954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.379002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841c31b-96c4-451a-8649-26eb571d954d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.379294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841c31b-96c4-451a-8649-26eb571d954d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.379573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841c31b-96c4-451a-8649-26eb571d954d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.392290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841c31b-96c4-451a-8649-26eb571d954d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c841c31b-96c4-451a-8649-26eb571d954d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:51.398714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:51.399616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:51.400410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:51.401407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 239/488] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:51.406464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d700e9-7d87-44c7-b8cd-ee7ccc228292 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.406464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d700e9-7d87-44c7-b8cd-ee7ccc228292 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.406464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d700e9-7d87-44c7-b8cd-ee7ccc228292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.410934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:51.426327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b3d700e9-7d87-44c7-b8cd-ee7ccc228292 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:51.429126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3d700e9-7d87-44c7-b8cd-ee7ccc228292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:51.466457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a3fa-31d2-488d-a36e-15b857e2a4f1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.504341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.505123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.505507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.505899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.515893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 240/489] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:51.517425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d700e9-7d87-44c7-b8cd-ee7ccc228292 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.517543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:51.519119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:51.534939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:51.536128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:51.537185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:51.537185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:51.537185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:51.537952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 250/490] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:51.551912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.565107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:51.639928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d700e9-7d87-44c7-b8cd-ee7ccc228292 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.679672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.680682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.681164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.681802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.682794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:51.683310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:51.684941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:51.694611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 241/491] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:51.702392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.737017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac13371-38b4-49ad-a74e-5fbc006ba4fe None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.748482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:51.774849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.775390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.776226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.776686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.777407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:51.777721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:51.779156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:51.792611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 251/492] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:51.798544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.868142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:51.876326 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32283e90-4828-4286-9a69-73af7874b3b1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.913284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f127a9-73d7-4516-9203-b264ee1e23cc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:51.914269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7202245-1649-47ce-a46b-ae2c0525f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.916347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7202245-1649-47ce-a46b-ae2c0525f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.917417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7202245-1649-47ce-a46b-ae2c0525f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.917917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7202245-1649-47ce-a46b-ae2c0525f6d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.932297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7202245-1649-47ce-a46b-ae2c0525f6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:51.933985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7202245-1649-47ce-a46b-ae2c0525f6d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:51.949404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:51.950036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.950321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.950598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c7202245-1649-47ce-a46b-ae2c0525f6d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:51.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:51.953689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:51.954621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:51.954621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:51.954621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:51.954621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 242/493] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:51.955980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c0ff-323b-428b-bb71-926355e8bedd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:51.955980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c0ff-323b-428b-bb71-926355e8bedd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:51.955980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c0ff-323b-428b-bb71-926355e8bedd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:51.956881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 243/494] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:51.957443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553c0ff-323b-428b-bb71-926355e8bedd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:51.965750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:51.967244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:25:51.980518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:51.981468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 252/495] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:51.987262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.017978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.084417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553c0ff-323b-428b-bb71-926355e8bedd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.093734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a782e-f680-437e-b786-30faf6da0c1c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.127331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db3511-4890-41a3-946c-430934149a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.128009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3511-4890-41a3-946c-430934149a9a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.128296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3511-4890-41a3-946c-430934149a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.128572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3511-4890-41a3-946c-430934149a9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.131918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.132530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.132815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.133094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.133743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:52.134048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.136203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:52.139281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db3511-4890-41a3-946c-430934149a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-76db3511-4890-41a3-946c-430934149a9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:52.144141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:52.145003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:52.145792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 244/496] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:52.146474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd7ab8-bd98-4572-9d74-36758951d5e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.147414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd7ab8-bd98-4572-9d74-36758951d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.147414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd7ab8-bd98-4572-9d74-36758951d5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.154559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 253/497] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:52.154559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.163645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.169603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-80bd7ab8-bd98-4572-9d74-36758951d5e1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:52.170797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-80bd7ab8-bd98-4572-9d74-36758951d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:52.236813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 245/498] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:52.238013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44adcd-c4d7-414e-ba8f-49034397c786 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.238301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44adcd-c4d7-414e-ba8f-49034397c786 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.238578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44adcd-c4d7-414e-ba8f-49034397c786 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.240120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 246/499] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:52.240822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44adcd-c4d7-414e-ba8f-49034397c786 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.251338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.265027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32bb35-5f97-4c54-ae81-df40b324d4ed None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.300570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.301171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.301448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.301718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.302445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:52.302744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.304244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:52.345909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 254/500] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:52.347121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.359114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44adcd-c4d7-414e-ba8f-49034397c786 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.395730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed3a6c-c9f8-40a1-ad2d-412bf5dac97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.396333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed3a6c-c9f8-40a1-ad2d-412bf5dac97b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.396612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed3a6c-c9f8-40a1-ad2d-412bf5dac97b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.396885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed3a6c-c9f8-40a1-ad2d-412bf5dac97b None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.397545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed3a6c-c9f8-40a1-ad2d-412bf5dac97b None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:52.397869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed3a6c-c9f8-40a1-ad2d-412bf5dac97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.399233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed3a6c-c9f8-40a1-ad2d-412bf5dac97b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:52.402351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.410216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 247/501] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:52.412132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7345b-c88b-43c6-baa2-ca1f7f317de9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.412425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7345b-c88b-43c6-baa2-ca1f7f317de9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.412703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7345b-c88b-43c6-baa2-ca1f7f317de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.433291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-38a7345b-c88b-43c6-baa2-ca1f7f317de9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:52.434868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-38a7345b-c88b-43c6-baa2-ca1f7f317de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:52.465378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1c856-f809-4c38-b9cf-ce1fd3885dec None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.504024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.504691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.505260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.505260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.509725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 248/502] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:52.511138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7345b-c88b-43c6-baa2-ca1f7f317de9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.512953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.514420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:25:52.528193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:52.529272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:52.530201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 255/503] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:52.530768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.542689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.624545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7345b-c88b-43c6-baa2-ca1f7f317de9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.643366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db03918-33da-472d-8eb3-e11c0999d275 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.653286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.663221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.664538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.664964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.665630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.678453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.679082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.679367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.679674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.690916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.692467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:52.706557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:52.707659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:52.708699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:52.708699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:52.708699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:52.708699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 256/504] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:52.708699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.749241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.750948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:52.771462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.813165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68721-960f-49a4-9c23-cfc32ccdd0a9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.846940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.847565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.847870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.848150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.854049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 249/505] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:52.854885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.858960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.860554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:52.875393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:52.876366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:52.877248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:52.877248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:52.877248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:52.877248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 257/506] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:52.877248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:52.884357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.957056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006651b6-1ec6-4679-bb8e-54182260285a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.977706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b556-202b-47a4-9544-249d2030606b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:52.990018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:52.991348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:52.992075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:52.992384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:52.992691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:52.993419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:52.993738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:52.995391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.012033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.012638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.012925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.013201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.013932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:53.014238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.015681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.028714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 258/507] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:53.029508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.033315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 250/508] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:25:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:53.034319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.124685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.134482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c40f1-46ef-4b87-877b-761c75edb18f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.140096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235a35-618c-4b0c-bcc2-12aff438f4e0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.168240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.168859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.169138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.169409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.173347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.173972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.174251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.174529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.179193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:53.184568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:53.185661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:53.188662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:53.189408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.189491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 259/509] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:53.189568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.189644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:53.206013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:53.206941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:53.207847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:53.207847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:53.207847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:53.207847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 251/510] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:53.208058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.222381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.292978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1d5a-c610-4dd2-9579-1f8136d6aac3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.307436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551179-38da-46f5-8a36-d588ffaac957 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.330806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.331414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.331734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.332011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.332655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:53.332958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.334348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.340691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.341318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.341597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.341868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.345564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 260/511] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:53.346350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.349149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.350575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.352355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:25:53.364926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:53.365942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:53.366856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.445937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.455009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cc19-51c0-4bca-9a34-2bbf8ddc8065 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.466997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d70fd-9ffd-46f4-a489-a089b3118ceb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.488383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.488988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.489277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.489563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.502408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.503017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.503305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.503579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.504269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:53.504586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.505959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.513742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 253/513] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:53.514520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.558187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.559760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.574501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.615802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292891-c2b9-4b9c-91ca-ecbc1297cdff None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.647908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.653179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.653784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.654066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.654343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.654976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:53.655278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.656684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.658493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 261/514] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:53.659369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.668901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 254/515] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:53.669716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.758649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90012-91eb-4d45-b13a-f774eadb60dc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.768226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2967f8-1146-40f7-91e8-4a9b94706bd2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.788129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.794095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999815e-61d1-4357-af04-789448294af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.794697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999815e-61d1-4357-af04-789448294af5 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.794981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999815e-61d1-4357-af04-789448294af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.795260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999815e-61d1-4357-af04-789448294af5 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.795939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999815e-61d1-4357-af04-789448294af5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.797381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999815e-61d1-4357-af04-789448294af5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.803014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.803644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.803933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.804211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.804947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:53.805263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.806696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:53.817968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 262/516] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:25:53 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:25:53.818879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999815e-61d1-4357-af04-789448294af5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.825361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 255/517] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:53.826023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:53.878369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:53.937026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999815e-61d1-4357-af04-789448294af5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.946245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709e991-853e-4cf9-a022-5f492e7e0604 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:53.976456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.977207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.977490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.977772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.988156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:53.988875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:53.989159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:53.989441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:53.990467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:53.991953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.002634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.004155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:54.010378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:54.011691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:54.012552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:54.012552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:54.012552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:54.012552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 263/518] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:54.012552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:54.022182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:54.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:54.024247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:54.024247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:54.024247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:54.024247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 256/519] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:54.024474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.064817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.118700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.122618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396af05-01e6-426d-96f3-e026a71a7f6c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.152998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7940b7-5c43-4c88-bf5b-285ab506dda9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.157545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.158180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.158459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.158733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.166149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.168614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:25:54.180673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:54.181715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:54.182730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 264/520] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:54.183298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.195969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.196823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.197288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.198128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.270777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.272406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.292371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263c32-bfe8-481b-8022-fcbd857f22e8 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.305097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.330869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.331481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.331784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.332055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.332693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:54.333002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.334564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.347188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 265/521] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:54.347861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.372627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.390076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 257/522] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:54.390076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.458911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262775d-518d-4d8e-8ddc-8d505286e3e7 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.493540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.494148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.495034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.495404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.496346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:54.496654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.498036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.502827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15ee02-a038-4394-841c-d11f97d2c55f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.513922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 266/523] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:54.513922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.535141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.543966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.545391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.545918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.546527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.548337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:54.548866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.550666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.574084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 258/524] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:54.575273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.603574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.624665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726161-840d-4a52-865d-0cf2bb31bca1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.661816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.662443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.662709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.662980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.671145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.673013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:25:54.683830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:54.684886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 267/525] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:54.685781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.693055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaddbf-3ef6-498a-a894-2e903c458cbe None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.731766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.732400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.732683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.732956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.743176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.744688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:54.760184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:54.761317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:54.762332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:54.762332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:54.762332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:54.765793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 259/526] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:54.766514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.801818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead9a0c-eb92-4bb8-b7f1-3d385c3fcf73 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.812183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.845633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.846424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.846807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.847182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.854284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.855909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.858920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:25:54.869901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:54.871166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:54.872359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:54.874665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 268/527] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:54.875527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:54.881531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed800f55-2479-4e3f-b7b8-2f4187cc26aa None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:54.919219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:54.919855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:54.920139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:54.920413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:54.921140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=717ade6a084349a8864cf15ce0d827fa) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:54.921448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:54.922936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:54.939419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 260/528] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/role_assignments?user.id=717ade6a084349a8864cf15ce0d827fa&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:54.939419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.011713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377db9a4-9c0e-497c-a002-e11148231a82 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.059206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.060684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.061040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.061642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.062488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:55.063125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.065449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.074221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b1d45-142f-4a6e-9f67-568a19bde486 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.083007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:55.089668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 269/529] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:55.090340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.138374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.139212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.139498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.141838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.142495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:55.142806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.144242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.157174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 261/530] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:55.158203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.178988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:55.236818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff1d37-213f-4256-a71b-6873235984d1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.274594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060647d-535c-4a4b-8d50-b757507734c2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.283126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.284152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.284680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.285154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.286153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:55.286657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.288435 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.314462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 270/531] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:55.314462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.317630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.318252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.318502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.318780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.354887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:55.392270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.393763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.433984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9ec2-c102-4301-ba1f-1ca60b769bc1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.464167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:55.472190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.473136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.473607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.474039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.482826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.484603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:25:55.497688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:55.498555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:55.499412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:55.501619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 271/532] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:55.502743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.509184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 262/533] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:55.509184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.575053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:55.613869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faf0b9-cd2d-4e51-854e-5bfc37246f06 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.619091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12899685-57bb-4249-84b3-850fd704b461 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.648850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.649332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.649620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.649900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.651252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:55.651643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.653078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.658978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.659904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.660477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.660945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.661860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=bc87886676534d46bee21984a515c138) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:55.662483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.664144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.671187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 263/534] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:55.677089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.677261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 272/535] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/role_assignments?user.id=bc87886676534d46bee21984a515c138&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:55.677261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.810149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba366385-a707-4693-baf7-25d687003be7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.811967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:55.857478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:55.868305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8866e-eed2-43c3-be7e-6c99549cdb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.869123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8866e-eed2-43c3-be7e-6c99549cdb79 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.870130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8866e-eed2-43c3-be7e-6c99549cdb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.870410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8866e-eed2-43c3-be7e-6c99549cdb79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.882096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8866e-eed2-43c3-be7e-6c99549cdb79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.883556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8866e-eed2-43c3-be7e-6c99549cdb79 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.884852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0643-a632-444b-ab27-3e14bf41709f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0df8866e-eed2-43c3-be7e-6c99549cdb79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:55.899376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:55.900513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:55.902349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:55.902349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:55.902349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:55.902349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 264/536] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:55.902349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6594a6-db4f-416d-984d-72826e249d45 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.902349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6594a6-db4f-416d-984d-72826e249d45 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.902687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6594a6-db4f-416d-984d-72826e249d45 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.906842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 265/537] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:55.907775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6594a6-db4f-416d-984d-72826e249d45 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:55.934081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63dfb9-c3b5-4628-b8fa-f6e409fd7910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:55.935264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63dfb9-c3b5-4628-b8fa-f6e409fd7910 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.935546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63dfb9-c3b5-4628-b8fa-f6e409fd7910 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.935900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63dfb9-c3b5-4628-b8fa-f6e409fd7910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.936639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63dfb9-c3b5-4628-b8fa-f6e409fd7910 None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=0621adefc6b340eba1ce85a4f64cae25) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:55.937003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63dfb9-c3b5-4628-b8fa-f6e409fd7910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:55.938470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63dfb9-c3b5-4628-b8fa-f6e409fd7910 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:55.945243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 273/538] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/role_assignments?user.id=0621adefc6b340eba1ce85a4f64cae25&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:55.947197 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a421b6e-da49-45d4-a2cd-6b7f6822cca6 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:55.947533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a421b6e-da49-45d4-a2cd-6b7f6822cca6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:55.947855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a421b6e-da49-45d4-a2cd-6b7f6822cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:55.994332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3a421b6e-da49-45d4-a2cd-6b7f6822cca6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:56.001042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3a421b6e-da49-45d4-a2cd-6b7f6822cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:56.100833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6594a6-db4f-416d-984d-72826e249d45 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:56.153379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 274/539] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:56.162655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:56.163272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:56.163552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:56.163848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:56.164492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:56.164796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:56.166219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:56.184905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 266/540] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:56.191612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a421b6e-da49-45d4-a2cd-6b7f6822cca6 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:56.247988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:56.317884 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a421b6e-da49-45d4-a2cd-6b7f6822cca6 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:56.353314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:56.354008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:56.354291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:56.354567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:56.361727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:56.363221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:25:56.375820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:56.376660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:56.377503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 275/541] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:56.382585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:56.461567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:56.517069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:56.545216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4f74-8e9c-431c-8150-df4d4a237394 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:56.582241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:56.583869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:56.584295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:56.585353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:56.586217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:56.586838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:56.589752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:56.607215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 267/542] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:25:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:56.615344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:56.701963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873072-7238-468e-afa2-3a1ecc50728b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:56.703917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:56.764044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:56.765820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:56.766102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:56.766370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:56.787624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:56.795176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:56.796134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:56.796930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:56.797538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 276/543] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:56.808898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06236123-67b6-497b-bb04-48db50f4ae37 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:56.810016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:56.823468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:56.853538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f57642-4975-41c7-8d53-009bde547ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:56.858896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57642-4975-41c7-8d53-009bde547ddb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:56.858896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57642-4975-41c7-8d53-009bde547ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:56.858896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57642-4975-41c7-8d53-009bde547ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:56.858896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57642-4975-41c7-8d53-009bde547ddb None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=e5f6af1603974cdba70d0d7d78e6777d) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:56.858896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57642-4975-41c7-8d53-009bde547ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:56.858896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57642-4975-41c7-8d53-009bde547ddb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:56.863388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 268/544] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:56 2022] GET /identity/v3/role_assignments?user.id=e5f6af1603974cdba70d0d7d78e6777d&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:57.016338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a971c38-0e6f-4265-a39c-094895dfcd50 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:57.057508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:57.058280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:57.058566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:57.058840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:57.059512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:57.059873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:57.061278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:57.064141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6651f8-9fc4-4723-9d41-0bcc5fc0890a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:57.064427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6651f8-9fc4-4723-9d41-0bcc5fc0890a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:57.064703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6651f8-9fc4-4723-9d41-0bcc5fc0890a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:57.066344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 269/545] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:57.071165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 277/546] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:57.071482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bce9c-af3a-42c8-8c93-f2a417a41bf5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:57.071790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bce9c-af3a-42c8-8c93-f2a417a41bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:57.072161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bce9c-af3a-42c8-8c93-f2a417a41bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:57.077674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:57.102749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:57.106354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2b5bce9c-af3a-42c8-8c93-f2a417a41bf5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:57.107578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2b5bce9c-af3a-42c8-8c93-f2a417a41bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:57.247222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 270/547] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:57.256762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8abba5-736e-46ac-ba04-469c7609d56f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:57.299960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:57.300875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:57.301333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:57.301803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:57.313222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:57.314987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:57.330750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:57.331767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:57.332627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:57.332627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:57.332627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:57.339807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 278/548] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:57.341380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bce9c-af3a-42c8-8c93-f2a417a41bf5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:57.437254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:57.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bce9c-af3a-42c8-8c93-f2a417a41bf5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:57.490287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:57.491138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:57.491565 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:57.492008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:57.492789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:57.493258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:57.495027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:57.511700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 271/549] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:57.513792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:57.606605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:57.645742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9cf79-9223-4466-844f-3451592d2447 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:57.646203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:57.685772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:57.686967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:57.687394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:57.687864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:57.702874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:57.705831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:25:57.728674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:57.733883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:57.734979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 279/550] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:57.751138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:57.808171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738d9c-0431-4b78-9b5c-2a040a1d48b4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:57.845371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:57.846807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:57.847292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:57.847828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:57.859351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:57.865019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:57.865924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:57.866912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:57.870245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 272/551] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:25:57.876072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:57.905440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:57.993347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efa2e0-2981-4946-9362-5cb522dabd2e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.002070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0773d7-db27-46cd-a916-7f50eb39396d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.030170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.037429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.038051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.038334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.038611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.039355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:58.039693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.041898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.042603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b469ec8-dfe5-46ac-8586-bd7aeb17463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.043544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469ec8-dfe5-46ac-8586-bd7aeb17463c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.044049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469ec8-dfe5-46ac-8586-bd7aeb17463c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.044617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469ec8-dfe5-46ac-8586-bd7aeb17463c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.045500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b469ec8-dfe5-46ac-8586-bd7aeb17463c None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:58.046002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b469ec8-dfe5-46ac-8586-bd7aeb17463c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.047570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b469ec8-dfe5-46ac-8586-bd7aeb17463c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.057563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 273/552] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:58.059294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0fd71-eab9-474e-add8-359ce8263c9e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.059877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0fd71-eab9-474e-add8-359ce8263c9e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.060352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0fd71-eab9-474e-add8-359ce8263c9e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.065037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 280/553] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Sep 5 10:25:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:58.065037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.066897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 274/554] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:58.069246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0fd71-eab9-474e-add8-359ce8263c9e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.175614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85107198-9276-440d-a799-66bb2af9fb0e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.175918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.204291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0fd71-eab9-474e-add8-359ce8263c9e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.211913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee38bce-82e2-47bb-86bc-3aa1f7c5f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.212566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38bce-82e2-47bb-86bc-3aa1f7c5f36d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.212849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38bce-82e2-47bb-86bc-3aa1f7c5f36d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.213189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38bce-82e2-47bb-86bc-3aa1f7c5f36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.224749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee38bce-82e2-47bb-86bc-3aa1f7c5f36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.226237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee38bce-82e2-47bb-86bc-3aa1f7c5f36d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-dee38bce-82e2-47bb-86bc-3aa1f7c5f36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:58.242461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:58.243516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:58.245105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:58.245105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:58.245105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:58.248073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 281/555] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:58.249450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef42b4-b60c-4b42-a2b9-4052bc854fd5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.249734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef42b4-b60c-4b42-a2b9-4052bc854fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.250016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef42b4-b60c-4b42-a2b9-4052bc854fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.251146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93197b16-e8ff-4288-a2fb-bee034d523b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.252061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197b16-e8ff-4288-a2fb-bee034d523b4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.252452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197b16-e8ff-4288-a2fb-bee034d523b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.252838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197b16-e8ff-4288-a2fb-bee034d523b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0eef42b4-b60c-4b42-a2b9-4052bc854fd5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:58.271264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0eef42b4-b60c-4b42-a2b9-4052bc854fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:58.307813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.328400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197b16-e8ff-4288-a2fb-bee034d523b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.329904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197b16-e8ff-4288-a2fb-bee034d523b4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.355614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 282/556] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:58.355614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef42b4-b60c-4b42-a2b9-4052bc854fd5 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.412192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.446358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 275/557] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:25:58.447895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277db5a-1ac4-44ca-950f-bd6a26cc19dd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.448285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277db5a-1ac4-44ca-950f-bd6a26cc19dd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.448664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277db5a-1ac4-44ca-950f-bd6a26cc19dd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.450500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 276/558] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:58.451420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277db5a-1ac4-44ca-950f-bd6a26cc19dd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.479865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef42b4-b60c-4b42-a2b9-4052bc854fd5 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.516146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b8fc9-6285-47c7-9e2a-2b5858845791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.516756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b8fc9-6285-47c7-9e2a-2b5858845791 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.517036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b8fc9-6285-47c7-9e2a-2b5858845791 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.517315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b8fc9-6285-47c7-9e2a-2b5858845791 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.517959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b8fc9-6285-47c7-9e2a-2b5858845791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:58.518263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b8fc9-6285-47c7-9e2a-2b5858845791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.519699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b8fc9-6285-47c7-9e2a-2b5858845791 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.536604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 283/559] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:58.537896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf36c-85a7-4bc9-a351-92b301b0e844 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.538184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf36c-85a7-4bc9-a351-92b301b0e844 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.538464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf36c-85a7-4bc9-a351-92b301b0e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.558543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-abcdf36c-85a7-4bc9-a351-92b301b0e844 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:58.559981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-abcdf36c-85a7-4bc9-a351-92b301b0e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:58.566186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277db5a-1ac4-44ca-950f-bd6a26cc19dd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.586089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.602310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.602998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.603336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.604498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.616670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.618136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:58.634513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:58.637228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:58.639382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:58.639382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:58.639382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:58.639907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 284/561] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:58.639907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdf36c-85a7-4bc9-a351-92b301b0e844 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.647748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 277/561] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:58.647748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.685436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.749362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdf36c-85a7-4bc9-a351-92b301b0e844 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.764540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899cbcb-9e3f-4f2e-81cf-22c9dd5c04a2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.788571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.789303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.789588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.789861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] PATH_INFO: `/v3/users/glance` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.799668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.801153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.804204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.804817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.805147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.805421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.806110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:58.806419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:58.807866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:25:58.813390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:58.815216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:25:58.817477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:58.826508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 285/562] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:58.826667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 278/563] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:58.826772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.829126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:58.850790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.944255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0156b0-9b25-415f-8fcc-baaf78bb7bce None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.952645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:58.969794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a00b5-5bcb-40ec-aacb-08dd6426388e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:58.982797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:58.983434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:58.983823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:58.984023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:58.994287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:59.000392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:59.001363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:59.002195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 286/564] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:59.006916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.009045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.009659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.009978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.010247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.011045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:59.011357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.012817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.029883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 279/565] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Sep 5 10:25:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:25:59.030701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.098840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.118914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa78bf-09ca-4913-8608-5b0437d72b53 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.136498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e309c4-615f-4570-8095-3a1f42116e82 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.154356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.154995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.155280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.155558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.162293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.163782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.170691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.171316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.171615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.171899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:25:59.175500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:59.176413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:59.177312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 287/566] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:59.177801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.186875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:25:59.191807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:59.192783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:59.193612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 280/567] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:59.194518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.197624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.280856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a9b8-3c4a-4d92-a440-d53d2f913b18 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.293530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de88735-58dd-4cb4-86dc-63a98a8eff91 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.314855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25a1c2-23b3-43b7-aafa-bba8a66b4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.315456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25a1c2-23b3-43b7-aafa-bba8a66b4f06 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.315763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25a1c2-23b3-43b7-aafa-bba8a66b4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.316045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25a1c2-23b3-43b7-aafa-bba8a66b4f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.316708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25a1c2-23b3-43b7-aafa-bba8a66b4f06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:59.317017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25a1c2-23b3-43b7-aafa-bba8a66b4f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.318406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25a1c2-23b3-43b7-aafa-bba8a66b4f06 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.326133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 288/568] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:59.326316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.326939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.327223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.327340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96984-b580-4156-8e2e-c9061bd7a532 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.327498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.327613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96984-b580-4156-8e2e-c9061bd7a532 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.327831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96984-b580-4156-8e2e-c9061bd7a532 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.329206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 289/569] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:25:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:25:59.332364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96984-b580-4156-8e2e-c9061bd7a532 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.335005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.340375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.341834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:59.356998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:59.357942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:59.358838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:59.358838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:59.358838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:59.358838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 281/570] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:59.359064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.414003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.442325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96984-b580-4156-8e2e-c9061bd7a532 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.458838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40adec-b29f-4842-8bd3-248ee6166b8f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.475684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.476288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.476567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.476841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.477528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:59.477832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.480103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.491988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c2fff-a317-4fae-bf60-0318768e06e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.492476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 290/571] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:59.492597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c2fff-a317-4fae-bf60-0318768e06e8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.492862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c2fff-a317-4fae-bf60-0318768e06e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.493140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c2fff-a317-4fae-bf60-0318768e06e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.493237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.493802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c2fff-a317-4fae-bf60-0318768e06e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:59.494112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c2fff-a317-4fae-bf60-0318768e06e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.496340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c2fff-a317-4fae-bf60-0318768e06e8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.504491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 282/572] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:59.505666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee7b4b-fa85-4179-ae02-986397a1d2a6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.505953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee7b4b-fa85-4179-ae02-986397a1d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.506230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee7b4b-fa85-4179-ae02-986397a1d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.523617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-98ee7b4b-fa85-4179-ae02-986397a1d2a6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:25:59.524832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-98ee7b4b-fa85-4179-ae02-986397a1d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:25:59.560022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.591240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 283/573] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:25:59.592193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee7b4b-fa85-4179-ae02-986397a1d2a6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.599155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca89157-420b-4978-80c4-4422d7d8e803 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.638341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.639136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.639422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.639737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.644109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.650252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.651881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:59.668465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:59.669418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:59.674977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:59.674977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:59.674977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:25:59.674977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 291/574] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:59.674977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.702517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee7b4b-fa85-4179-ae02-986397a1d2a6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.737075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.737604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.737940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.738226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.738867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:59.739174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.742397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.759435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 284/575] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:59.759435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.786284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77847694-6a0d-4b71-986b-94cfab3c2c3e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.801239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.824117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.824728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.825013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.825294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.826016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=e810111bda874bf2aa808991089c2197) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:25:59.826331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.827815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.843631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 292/576] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/role_assignments?user.id=e810111bda874bf2aa808991089c2197&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:25:59.843631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.871385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56568a5b-11ba-458f-8f62-15eb973d03e3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:25:59.882123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:25:59.912873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:25:59.913523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:25:59.913804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:25:59.914078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:25:59.925962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:25:59.927450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:25:59.943848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:25:59.944917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:25:59.945828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:25:59.945828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:25:59.945828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:25:59.945828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 285/577] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:25:59.945828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:25:59.967852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed3b5-ffc2-4a55-a7cc-b9f6f7b223f0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.011153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912932b-a929-494e-b849-19fe79876773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.011793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912932b-a929-494e-b849-19fe79876773 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.012078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912932b-a929-494e-b849-19fe79876773 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.012357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912932b-a929-494e-b849-19fe79876773 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.012999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912932b-a929-494e-b849-19fe79876773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:00.013305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912932b-a929-494e-b849-19fe79876773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.014690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912932b-a929-494e-b849-19fe79876773 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.027325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 293/578] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:00.028184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912932b-a929-494e-b849-19fe79876773 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.059693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f61c7-730d-4e62-9936-ada1a4b73bde None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.070311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.098403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.099275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.099769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.100187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.107958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.109574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:00.122279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:00.123398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:00.124393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:00.126019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 286/579] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:00.126999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.152381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912932b-a929-494e-b849-19fe79876773 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.152611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.190139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.190895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.191242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.191621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.202779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:00.207716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:00.208810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:00.209841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:00.210909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 294/580] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:00.216738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.243450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd3d6-08f9-42c6-8beb-54546ebdf8d0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.281125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.281653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.281931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.282230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.282894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:00.283200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.284680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.297009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 287/581] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:00.297643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.331093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.336208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66fb9e-dc16-4c80-9097-1f19de9da014 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.374941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.376001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.376869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.377264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.388772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.390240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.391682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:00.403475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:00.404514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 295/582] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:00.405460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.421705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba42e-8b5d-42de-bae4-c81f21a80aee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.458845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.459724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.460155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.460606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.461437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:00.461890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.464263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.481501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 288/583] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:00.482378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.517654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488246b1-0f9c-47ef-853b-6ebc80b555e4 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.551535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.552090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.552369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.552643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.553300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:00.553600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.554963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.568761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 296/584] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:00.568761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.591358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.596753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620c78c-037c-4e79-ae88-74f19115923b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.633090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.633901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.634182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.634505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.644007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.645509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.648231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:00.659433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:00.660581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 289/585] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:00.661545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.677247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee049a9f-85e6-4a4b-8f6a-c8fe23c2537d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.712479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.713245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.713739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.714111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.714844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:00.715153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.716616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.738065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 297/586] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:00.738065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.774886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db20dfa-009e-417b-b0a2-8caa0167c9dd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.814088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.814673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.814958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.815790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/717ade6a084349a8864cf15ce0d827fa/roles/c1bfa1f1c0a34c94b82d6269e57d15e5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.819311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.835226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=717ade6a084349a8864cf15ce0d827fa, role_id=c1bfa1f1c0a34c94b82d6269e57d15e5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.836862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.844673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a772319-8b5f-4607-a0c4-96e124b3b8d0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:00.850890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 290/587] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:00 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/717ade6a084349a8864cf15ce0d827fa/roles/c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:00.851919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.892882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:00.893699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:00.894079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:00.894456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:00.907970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:00.909727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:00.920889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:00.931038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:00.932464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:00.933586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:00.933586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:00.933586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:00.939322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 298/588] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:00.939322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:00.999605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da503f-8c5a-44cc-b128-efa8a2df7806 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.038396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.039276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.039563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.039869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.040769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:01.041115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.042869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.059283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f54cde-9f74-4008-8947-73dc026501d7 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.065960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 291/589] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:01.066580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.097967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:01.106223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.106877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.107161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.107443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.122457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.124498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:01.146828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:01.148114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:01.149222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:01.149222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:01.149222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:01.149222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 299/590] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:01.149222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.199383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d4707-d893-439b-9e28-f77b83dd3428 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.209414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:01.238270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.238732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.239029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.239308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.239986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:01.240299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.241679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.255158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 292/591] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:01.260344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.265145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06d3e6-ca2a-4e8a-a763-99d7e2172b55 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.302112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.303078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.303548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.304080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.316224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.317889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:01.333401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:01.334623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:01.335695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:01.335695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:01.335695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:01.337378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 300/592] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:01.343342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.371393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef127-375c-43e2-9ca4-4997c660d0e0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.381518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:01.407698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.408534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.408728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.409031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.409705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:01.410018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.411688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.430249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 293/593] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:01.431236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.457603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4ee2-935c-4fba-b970-a14dee186ad7 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.463946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:01.495283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.496634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.497121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.497646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.505886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.507630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:01.519647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:01.520647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:26:01.521620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:01.523892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 301/594] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:01.524890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.544786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaba63c-1c15-4734-b202-ff47ae3690a8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.583110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.583688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.583982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.584256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.584909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:01.585215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.586814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.605315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 294/595] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:01.605315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.644353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:01.653478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0968deb-b71d-4551-b234-7c3bdee5aa8c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.697216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:01.698545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.700302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.700948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.701643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.711183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.711506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c158d8e-6dc2-4133-a01c-a69f992830bc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.714174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:01.728315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:01.729544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:01.730600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:01.733198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 302/596] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:01.734267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.753348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.753966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.754275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.754834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.755370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:01.758083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.759699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.784219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 295/597] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:01.785135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.851139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee87a-6ad3-4b82-82ea-d79aa40ecf8f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.886884 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.887515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.887827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.888101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.894698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.896181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.899650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7b709-7b51-417f-9334-f4893a831fc9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:01.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:01.909094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:01.910192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:01.913666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 303/598] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:01.914520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.930722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:01.945307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f6345-63eb-49c9-a40a-c902afd44c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:01.945917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6345-63eb-49c9-a40a-c902afd44c91 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.946200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6345-63eb-49c9-a40a-c902afd44c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.946476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f6345-63eb-49c9-a40a-c902afd44c91 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.947172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f6345-63eb-49c9-a40a-c902afd44c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:01.947510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f6345-63eb-49c9-a40a-c902afd44c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:01.948989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f6345-63eb-49c9-a40a-c902afd44c91 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:01.961199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 296/599] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:01.962252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aababd-11ec-4d53-aa39-7e0ca15f9263 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:01.962544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aababd-11ec-4d53-aa39-7e0ca15f9263 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:01.962822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aababd-11ec-4d53-aa39-7e0ca15f9263 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:01.964368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 297/600] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:01.964958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aababd-11ec-4d53-aa39-7e0ca15f9263 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:01.979400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:02.032046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2c76-5e71-4e82-8f5d-9cacb0cdf39f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.076192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.076426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.076859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.076859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.080820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aababd-11ec-4d53-aa39-7e0ca15f9263 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.087717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:02.089754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:02.105254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:02.106242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:02.112388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:02.112388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:02.112388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:02.112388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 304/601] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:02.112388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:02.126579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b340b-e6c0-418c-8ac1-a087649a1fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.127189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b340b-e6c0-418c-8ac1-a087649a1fad None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.127366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b340b-e6c0-418c-8ac1-a087649a1fad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.127783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b340b-e6c0-418c-8ac1-a087649a1fad None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.128544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b340b-e6c0-418c-8ac1-a087649a1fad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:02.129057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b340b-e6c0-418c-8ac1-a087649a1fad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:02.130331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b340b-e6c0-418c-8ac1-a087649a1fad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:02.147522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 298/602] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:02.147522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7e76-a551-489a-a7ab-ba906dc49b26 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.147522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7e76-a551-489a-a7ab-ba906dc49b26 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.147522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7e76-a551-489a-a7ab-ba906dc49b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.164029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-528e7e76-a551-489a-a7ab-ba906dc49b26 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:02.165273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-528e7e76-a551-489a-a7ab-ba906dc49b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:02.200287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:02.235330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4162a19-d874-47b7-8964-d1b026ee4d53 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.236164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:02.247626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 299/603] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:02.247626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e7e76-a551-489a-a7ab-ba906dc49b26 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:02.290321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.292480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.292944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.293658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/bc87886676534d46bee21984a515c138/roles/c1bfa1f1c0a34c94b82d6269e57d15e5` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.312789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=bc87886676534d46bee21984a515c138, role_id=c1bfa1f1c0a34c94b82d6269e57d15e5)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:02.314332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:02.329873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 305/604] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:02 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/bc87886676534d46bee21984a515c138/roles/c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:02.330826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:02.366488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e7e76-a551-489a-a7ab-ba906dc49b26 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.412238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.413265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.414036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.414530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.415410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:02.416566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:02.418901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:02.434678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 300/605] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:02.441205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:02.521197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:02.551331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4915e2-db85-49df-954a-70d98df060da None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.577866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:02.602914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5435-9d49-44b4-b5b9-3d724720088f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.606028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.606869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.607260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.607704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/0621adefc6b340eba1ce85a4f64cae25/roles/c1bfa1f1c0a34c94b82d6269e57d15e5` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.626874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=0621adefc6b340eba1ce85a4f64cae25, role_id=c1bfa1f1c0a34c94b82d6269e57d15e5)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:02.628455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:02.644823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 306/606] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:02 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/0621adefc6b340eba1ce85a4f64cae25/roles/c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:02.651617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:02.654658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.655417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.656343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.656635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.676568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:02.680176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:02.710334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:02.711303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:02.712250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:02.714493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 301/607] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:02.720002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:02.818938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d2199-7f88-4830-9c6b-d88e838f4844 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.865114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.865762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.866038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.866317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.881316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:02.889190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:02.890154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:02.890995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 307/608] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:02.903867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:02.910167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4ecdb-d90f-45fc-963f-10aff96a00c0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:02.930111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:02.943277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:02.956457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6142b-1df0-4897-b8f2-d2ce15f6c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:02.957513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6142b-1df0-4897-b8f2-d2ce15f6c218 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.957799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6142b-1df0-4897-b8f2-d2ce15f6c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.958081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6142b-1df0-4897-b8f2-d2ce15f6c218 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.958787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6142b-1df0-4897-b8f2-d2ce15f6c218 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:02.959099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6142b-1df0-4897-b8f2-d2ce15f6c218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:02.960618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6142b-1df0-4897-b8f2-d2ce15f6c218 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:02.974445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 302/609] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:02.979925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd09ef-108d-42da-bdbe-7e36af0fb25f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:02.980249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd09ef-108d-42da-bdbe-7e36af0fb25f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:02.980533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd09ef-108d-42da-bdbe-7e36af0fb25f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:02.982149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 303/610] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:02.984516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd09ef-108d-42da-bdbe-7e36af0fb25f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:03.039535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bed939-5b06-442c-b54e-f000cae12909 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:03.094448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20426f20-387a-4a40-9776-f66467d40d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:03.095262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20426f20-387a-4a40-9776-f66467d40d60 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:03.095552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20426f20-387a-4a40-9776-f66467d40d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:03.096209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20426f20-387a-4a40-9776-f66467d40d60 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:03.097227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20426f20-387a-4a40-9776-f66467d40d60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:03.097635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20426f20-387a-4a40-9776-f66467d40d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:03.099372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20426f20-387a-4a40-9776-f66467d40d60 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:03.099509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd09ef-108d-42da-bdbe-7e36af0fb25f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:03.119763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 308/611] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:03.121525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36b883-4c3c-449b-9584-6ee1ed8311ef None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:03.121818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36b883-4c3c-449b-9584-6ee1ed8311ef None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:03.122103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36b883-4c3c-449b-9584-6ee1ed8311ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:03.147897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5b36b883-4c3c-449b-9584-6ee1ed8311ef None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:03.149328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5b36b883-4c3c-449b-9584-6ee1ed8311ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:03.149548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:03.150276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:03.150612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:03.150944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/e5f6af1603974cdba70d0d7d78e6777d/roles/c1bfa1f1c0a34c94b82d6269e57d15e5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:03.171027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=e5f6af1603974cdba70d0d7d78e6777d, role_id=c1bfa1f1c0a34c94b82d6269e57d15e5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:03.172916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:03.191009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 304/612] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:02 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/e5f6af1603974cdba70d0d7d78e6777d/roles/c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:03.192028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:03.251903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 309/613] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:03.285809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:03.385199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc365bc-0dc5-450c-98c3-cb77e3e3057e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:03.421557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:03.422117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:03.422402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:03.422683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:03.433443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:03.434914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:03.450933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:03.451918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:03.452850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:03.452850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:03.452850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:03.452850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 305/614] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:03.458015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36b883-4c3c-449b-9584-6ee1ed8311ef None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:03.480035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:03.570174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:03.595168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36b883-4c3c-449b-9584-6ee1ed8311ef None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:03.660109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:03.660732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:03.661015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:03.661290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:03.661941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:03.662245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:03.663656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:03.688148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 310/615] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:03.694652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:03.698727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:03.738810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248fcf-2615-4b92-82d6-dde67a30c1ba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:03.790898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:03.791583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:03.791890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:03.792267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:03.802561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:03.808656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:03.809623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:03.810491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 306/616] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:03.816469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:03.847104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:03.886185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6a87-051d-4d1e-aaef-5ea7578bdfd0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:03.953508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:03.954066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:03.954343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:03.954613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:03.966595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:03.968150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:03.989121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:03.990137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:03.991116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:03.992810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 311/617] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:03.997845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:04.006343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159924a-8f69-452b-8104-60a5e133c03f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:04.070289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:04.075159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.075520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.075737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.076509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:04.076821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:04.078254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:04.091976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:04.102478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 307/618] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:04.107900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:04.193020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f8d3e-850e-4218-a9d3-3adc6b1dd9ce None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:04.245585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:04.246522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.246808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.247081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.248020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:04.248206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:04.249705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:04.265251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:04.267692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866683ae-8f54-492b-80a6-afceba50ae5d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:04.287056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 312/619] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Sep 5 10:26:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:04.299948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:04.309463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:04.310365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.310791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.311374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.321942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:04.324632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:04.340027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:04.341190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:04.342242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:04.342242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:04.342242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:04.343991 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 308/620] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:04.349318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:04.459974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:04.513126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2a018-232a-4660-b28a-bf76e389bdb2 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:04.553372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62796c-c801-428a-8cc8-ab9eee714ff4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:04.580941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e776331-2f26-4c6f-8c03-9dde974ce280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:04.581575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776331-2f26-4c6f-8c03-9dde974ce280 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.581853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776331-2f26-4c6f-8c03-9dde974ce280 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.582124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e776331-2f26-4c6f-8c03-9dde974ce280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.605098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e776331-2f26-4c6f-8c03-9dde974ce280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:04.606977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e776331-2f26-4c6f-8c03-9dde974ce280 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-0e776331-2f26-4c6f-8c03-9dde974ce280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:04.629644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:04.630638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:04.631527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:04.631527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:04.631527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:04.634793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 313/621] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:04.639659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0d591-db9c-4dcf-96b1-9195ced6db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:04.639659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d591-db9c-4dcf-96b1-9195ced6db72 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.639659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d591-db9c-4dcf-96b1-9195ced6db72 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.639659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d591-db9c-4dcf-96b1-9195ced6db72 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.640006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0d591-db9c-4dcf-96b1-9195ced6db72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:04.640006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0d591-db9c-4dcf-96b1-9195ced6db72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:04.640006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0d591-db9c-4dcf-96b1-9195ced6db72 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:04.641594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f478-0c0c-4f55-8eab-f2852c27568d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.642151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f478-0c0c-4f55-8eab-f2852c27568d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.642497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f478-0c0c-4f55-8eab-f2852c27568d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.647837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 314/622] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:04.647837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f478-0c0c-4f55-8eab-f2852c27568d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:04.657345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 309/623] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:04.658798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c76760-55c3-4152-8dca-1796929157bd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.659269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c76760-55c3-4152-8dca-1796929157bd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.659778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c76760-55c3-4152-8dca-1796929157bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.678818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f2c76760-55c3-4152-8dca-1796929157bd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:04.680318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f2c76760-55c3-4152-8dca-1796929157bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:04.702001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:04.767721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 310/624] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:04.767721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c76760-55c3-4152-8dca-1796929157bd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:04.787920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f478-0c0c-4f55-8eab-f2852c27568d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:04.854423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:04.862791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:04.863882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:04.864471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:04.866110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:04.867724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:04.868414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:04.870961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:04.896167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 315/625] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:04.902428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:04.976614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c76760-55c3-4152-8dca-1796929157bd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.030281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4698-633b-41f7-9d21-2b00594a5ec5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.040794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:05.045730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.046373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.046658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.046918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.070617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.071373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.071801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.072192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.073633 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.075183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.080719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.082247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:05.092360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:05.093368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 10:26:05.094387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:05.096774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 311/626] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:05.097705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:05.102495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:05.103536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 316/627] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:05.104536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.216552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269be50-2c8b-43d0-aa7e-8c949d3c5bec None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.218313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe62edf-4c61-4cc0-b2fd-2ed254889310 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.220018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:05.253110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affef801-3bb0-49b3-b6ae-7509ddc6d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.253723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef801-3bb0-49b3-b6ae-7509ddc6d385 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.254008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef801-3bb0-49b3-b6ae-7509ddc6d385 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.254288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affef801-3bb0-49b3-b6ae-7509ddc6d385 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.255024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affef801-3bb0-49b3-b6ae-7509ddc6d385 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:05.255148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.255344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affef801-3bb0-49b3-b6ae-7509ddc6d385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.255778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.256066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.256345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.256806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affef801-3bb0-49b3-b6ae-7509ddc6d385 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.268421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:05.273286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:05.274216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:05.275048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 312/628] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:05.275843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.283203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 317/629] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:05.283203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24909cf-f43a-4b85-97d6-d475c401c83f None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.283203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24909cf-f43a-4b85-97d6-d475c401c83f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.283203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24909cf-f43a-4b85-97d6-d475c401c83f None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.285702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 318/630] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:05.286487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24909cf-f43a-4b85-97d6-d475c401c83f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.317339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:05.383765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009f5e3-048b-443a-8bd5-e7a92dba048e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.399476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24909cf-f43a-4b85-97d6-d475c401c83f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.420306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.421027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.421490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.421910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.422671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:05.423111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.424775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.437565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a774dbc-3aa1-4413-88a3-98fc0671794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.437891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 313/631] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:05.438175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774dbc-3aa1-4413-88a3-98fc0671794f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.438456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774dbc-3aa1-4413-88a3-98fc0671794f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.438731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774dbc-3aa1-4413-88a3-98fc0671794f None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.438827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.439401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774dbc-3aa1-4413-88a3-98fc0671794f None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:05.439734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774dbc-3aa1-4413-88a3-98fc0671794f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.441099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774dbc-3aa1-4413-88a3-98fc0671794f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.449897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 319/632] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:05.451055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0984f-39af-420b-b06e-a14f30944c46 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.451341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0984f-39af-420b-b06e-a14f30944c46 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.451643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0984f-39af-420b-b06e-a14f30944c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.469396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-75a0984f-39af-420b-b06e-a14f30944c46 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:05.470601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-75a0984f-39af-420b-b06e-a14f30944c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:05.470735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:05.537783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 320/633] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:05.538999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c57c-1df9-44ea-9540-ae2f1020fce0 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.539290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c57c-1df9-44ea-9540-ae2f1020fce0 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.539565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c57c-1df9-44ea-9540-ae2f1020fce0 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.541478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 321/634] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:05.544852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c57c-1df9-44ea-9540-ae2f1020fce0 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.547159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a140ba-aa4f-4caa-8132-1a692c9b4e7f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.574643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:05.583146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef278b-b739-4f46-92d7-46b6f2d06d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.583789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef278b-b739-4f46-92d7-46b6f2d06d15 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.584068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef278b-b739-4f46-92d7-46b6f2d06d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.584344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef278b-b739-4f46-92d7-46b6f2d06d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.660090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef278b-b739-4f46-92d7-46b6f2d06d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.661016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c57c-1df9-44ea-9540-ae2f1020fce0 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.661573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef278b-b739-4f46-92d7-46b6f2d06d15 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.687994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:05.697570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.698719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.698992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/e810111bda874bf2aa808991089c2197/roles/c1bfa1f1c0a34c94b82d6269e57d15e5` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.714135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=e810111bda874bf2aa808991089c2197, role_id=c1bfa1f1c0a34c94b82d6269e57d15e5)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.715608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.730288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 322/635] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:05 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/e810111bda874bf2aa808991089c2197/roles/c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:05.731099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.785522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 314/636] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:05.787380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b12c6e-6387-4b63-8b61-8c7400102b0a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.788009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b12c6e-6387-4b63-8b61-8c7400102b0a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.788497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b12c6e-6387-4b63-8b61-8c7400102b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.812974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a9b12c6e-6387-4b63-8b61-8c7400102b0a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:05.814322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a9b12c6e-6387-4b63-8b61-8c7400102b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:05.831290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:05.875413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4028-7c19-43cb-8487-373808fcdadc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:05.898200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 315/637] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:05.899071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b12c6e-6387-4b63-8b61-8c7400102b0a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.919990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:05.920697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:05.920915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:05.921192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:05.932082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:05.933669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:05.950021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:05.951027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:05.951970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:05.951970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:05.951970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:05.951970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 323/638] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:05.951970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:05.971080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.032567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b12c6e-6387-4b63-8b61-8c7400102b0a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.077040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.077899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.078145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.078419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.089171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775266a-8122-486d-8108-182a6eebfa29 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.094927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.096425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.114239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:06.116887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:06.118511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:06.120327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:06.120327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:06.120327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:06.127505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 316/639] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:06.128710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.139066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.139811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.140098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.140383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.156450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:06.162488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:06.163439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:06.164338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:06.167908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 324/640] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:06.168868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.256205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cecbd-9050-4344-9fed-54ff026d9bc1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.258537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.282836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f7115-dd00-4d18-9270-fda73c0a671b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.293771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.294388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.294673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.294952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.295625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:06.295937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.297305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.310357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 317/641] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:06.311033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.323803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.324471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.324767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.325046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.325703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:06.326015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.327451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.344556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 325/642] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:06.344556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.384480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.428040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56631f-bce0-4339-b14b-70c8f4d9e0b5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.452345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7359b-0845-4f5e-8531-ae49fb9785d3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.469777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.470639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.471048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.471334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.472039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:06.472350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.473737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.482202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 318/643] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:06.482799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.494029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.494684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.494958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.495234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.506344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:06.511619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:06.512642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 326/644] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:06.513503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.515437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.599240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f81c-0e0b-46d3-bf0d-edc973952042 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.616828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.620589 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337714a-af24-4e06-b37f-b56e48d3f40a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.636344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.637033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.637320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.637595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.646262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.647750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.659322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:06.659978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:06.660946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:06.662567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:06.663155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.663155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.663155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.663355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 319/645] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:06.663355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.673226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.674703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:06.686959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:06.687919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 327/646] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:06.689442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.761687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.778318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b98b6-5a83-42fd-b3d0-bae4c9463cdd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.802853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0083-1ff6-4ce9-945d-a2599db6f0f3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.812993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.813623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.813915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.814197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.825115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.826568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.841038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:06.841681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:06.842619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:06.848636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:06.848636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:06.848636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:06.848822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:06.848822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:06.848822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:06.848822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:06.849059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 320/647] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:06.849140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:06.849213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.849333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:06.860454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 328/648] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:06.861330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:06.888203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:06.964370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4385d26-6cab-423f-8c48-56ccaf63bba5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:06.971525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe1585-786b-454a-8673-b9ab43a04b5c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.003273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.004018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.004615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.004753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.005431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:07.005817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.007490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.009100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.009932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.010218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.010494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.011187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:07.011492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.012981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.016290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.030537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 329/649] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:07.030537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.030793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 321/650] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:26:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:07.030793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.117711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.142672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048b6d7-d36e-40ae-8e67-448ecf216190 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.144516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398ff50-7198-4d01-8a9f-3fc0b207144f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.178976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.179627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.179911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.180241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.180531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.181140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.181508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.182460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.183304 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:07.183640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.185031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.191435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.192926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.201162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 330/651] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:07.201162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:07.216829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:07.217916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:07.219448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:07.219448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:07.219448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:07.219448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 322/652] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:07.219448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.272931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.312543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89306-b48e-4015-b3c6-0a1a414dc443 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.331844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687b7e-599d-40e6-b2ef-5d45353f3d50 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.347615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.348270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.348555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.348834 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.349565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=717ade6a084349a8864cf15ce0d827fa) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:07.349878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.351319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.358100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 331/653] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/role_assignments?user.id=717ade6a084349a8864cf15ce0d827fa&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:07.358888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.376782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.386134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.387272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.387650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.387999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.472956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.474556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.511650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a15f-d975-4f48-a6d9-0f3eb3c3c04c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.534552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.565020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.565670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.565958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.566240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.574463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.576001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:07.593783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:07.594818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 332/654] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:07.597199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.609364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 323/655] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:07.609364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.685505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.717111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1ebad-1855-4156-aee5-1dd5e385d6c5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.739766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2e73-328a-41e4-97d2-b407cc401138 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.755969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.756800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.757089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.757361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.758100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:07.758408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.759922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.777447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 324/656] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:07.780157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6fe1-8215-4abc-b1f5-d376e5442ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.780767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6fe1-8215-4abc-b1f5-d376e5442ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.781052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6fe1-8215-4abc-b1f5-d376e5442ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.781327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6fe1-8215-4abc-b1f5-d376e5442ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.782069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6fe1-8215-4abc-b1f5-d376e5442ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:07.782380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6fe1-8215-4abc-b1f5-d376e5442ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.782582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.783794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6fe1-8215-4abc-b1f5-d376e5442ef5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.791867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.800002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 333/657] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:07.801266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045105-c271-4ff0-ab3b-41944064544e None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.801557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045105-c271-4ff0-ab3b-41944064544e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.801830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045105-c271-4ff0-ab3b-41944064544e None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.809019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 334/658] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:07.809019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96045105-c271-4ff0-ab3b-41944064544e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:07.894033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6b19c-2bbd-454e-b00f-18fa75385834 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.921024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96045105-c271-4ff0-ab3b-41944064544e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:07.929748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.930381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.930650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.930926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.942621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:07.944022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:07.950355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:07.962007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:07.968058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:07.969023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:07.969023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:07.969023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:07.969195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:07.969195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:07.969195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:07.969195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:07.969474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 325/659] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:07.969474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.029105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.047170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.049307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.074523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9406c7-f01e-44ae-91b5-020023013cd2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.111831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7367a9-cf32-4718-ba04-f59e7fdee7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.112463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7367a9-cf32-4718-ba04-f59e7fdee7ea None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.112739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7367a9-cf32-4718-ba04-f59e7fdee7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.113014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7367a9-cf32-4718-ba04-f59e7fdee7ea None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.123324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7367a9-cf32-4718-ba04-f59e7fdee7ea None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.126114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7367a9-cf32-4718-ba04-f59e7fdee7ea None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-fa7367a9-cf32-4718-ba04-f59e7fdee7ea None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:08.140273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:08.141466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:08.142623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 326/660] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:08.143239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a53d-4b70-4634-85c6-048f5da1f914 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.143239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a53d-4b70-4634-85c6-048f5da1f914 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.143239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a53d-4b70-4634-85c6-048f5da1f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.162635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b834a53d-4b70-4634-85c6-048f5da1f914 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:08.164136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b834a53d-4b70-4634-85c6-048f5da1f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:08.165555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 335/661] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:08.167367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.195877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.251652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 327/662] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:08.251652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834a53d-4b70-4634-85c6-048f5da1f914 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.290611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264489-14a4-4e0b-915c-eb50d8fa7896 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.305788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.332777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.333522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.333932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.334311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.335061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:08.335468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.336995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.350098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 336/663] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:08.350983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.380514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834a53d-4b70-4634-85c6-048f5da1f914 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.427008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.428173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.428615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.429970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.430962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:08.431518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.433389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.448624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.461596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 328/664] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:08.461596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.477625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26d07-13f8-446f-b893-08dbe7d64ef5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.528107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.529635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.530152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.531193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.545147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.546630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:08.561036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:08.562014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:08.562910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:08.562910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:08.562910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:08.562910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 337/665] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:08.562910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.571630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6443-3c33-4aca-865f-b5d65f051555 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.580268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.611364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.612092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.612312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.612588 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.620340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.621817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:08.632935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:08.633846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 329/666] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:08.635503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.683081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f2cea-c918-47c3-aa35-2115c77e187a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.720778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.721318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.721604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.722292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.733552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.748276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1023-8f97-4969-aba6-8f28ae27d727 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.787906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.788840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.789307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.789781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.796595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.798069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.800935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:08.807984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:08.809000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 330/667] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:08.809870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.839710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.911392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 338/668] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:08.912543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:08.923567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a620-b8c2-4f8c-be1d-e4e34c540a6f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:08.955069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:08.962232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:08.963099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:08.963382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:08.963911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:08.964337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:08.964648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:08.966028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:08.979210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 331/669] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:08.980461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.022888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf0d41-e106-4cfc-b275-378c4cda3cf2 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.059144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.059855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.060069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.060343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.061046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:09.061355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.062803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.073644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:09.082336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 339/670] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:09.082336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.089539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043639b-c1a6-4f22-9b35-b906cf8513d6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.128329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.128946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.129230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.129506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.130169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:09.130482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.131872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.141196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 332/671] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:09.141825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.199063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:09.203466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdf4fb-bb50-4385-9b5e-567087720dc9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.238198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.238750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.239059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.239338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.250651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123187-7d39-4b57-b700-e89cba5d4946 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.250865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.252360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:09.267526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:09.268726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:09.269920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:09.269920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:09.269920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:09.271291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 340/672] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:09.272237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.290066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.291222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.291510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.291821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.299861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.301705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:09.314087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:09.315638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:09.316768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:09.319919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 333/673] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:09.320734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.331976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:09.388718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226e7f5-acd0-40b2-a2ae-64d4ae6abe30 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.425062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.425682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.425992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.426421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.427014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=bc87886676534d46bee21984a515c138) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:09.427271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.428756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.429124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c883a8-9fc2-4e31-8889-fb930fb0ed0a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.443914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 341/674] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/role_assignments?user.id=bc87886676534d46bee21984a515c138&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:09.443914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.459772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:09.477421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.478081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.478924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.479371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.491628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.493093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:09.510207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:09.511408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:09.512602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:09.512602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:09.512602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:09.516178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 334/675] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:09.517108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.559811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f7a5-d8f0-4a30-b8d3-73a437a7b3ea None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.582424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:09.600579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86902c0e-109b-4e42-a1d5-ddcc25f12355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.601764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902c0e-109b-4e42-a1d5-ddcc25f12355 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.601764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902c0e-109b-4e42-a1d5-ddcc25f12355 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.601935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902c0e-109b-4e42-a1d5-ddcc25f12355 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.602480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86902c0e-109b-4e42-a1d5-ddcc25f12355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:09.602789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86902c0e-109b-4e42-a1d5-ddcc25f12355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.605691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86902c0e-109b-4e42-a1d5-ddcc25f12355 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.623049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 342/676] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:09.624132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732128-1ffa-43fa-8134-54ad85cebfcb None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.624423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732128-1ffa-43fa-8134-54ad85cebfcb None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.624702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732128-1ffa-43fa-8134-54ad85cebfcb None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.626045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 343/677] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:09.626597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732128-1ffa-43fa-8134-54ad85cebfcb None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.639101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c1a4-c16c-46da-afc7-b22bfff6ef62 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.677744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.678360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.678638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.678906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.679634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:09.679992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.681483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.694109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 335/678] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:09.694929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.715368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:09.746584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732128-1ffa-43fa-8134-54ad85cebfcb None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.782899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d54aa-360d-47f5-a6d5-2e4ea1d7d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.783861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d54aa-360d-47f5-a6d5-2e4ea1d7d45c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.784358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d54aa-360d-47f5-a6d5-2e4ea1d7d45c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.784642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d54aa-360d-47f5-a6d5-2e4ea1d7d45c None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.785302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d54aa-360d-47f5-a6d5-2e4ea1d7d45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:09.785613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d54aa-360d-47f5-a6d5-2e4ea1d7d45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.787002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d54aa-360d-47f5-a6d5-2e4ea1d7d45c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.803658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 344/679] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:09.803658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d34ff6-bc61-4770-8dfe-3df3d5b2c93f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.803658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d34ff6-bc61-4770-8dfe-3df3d5b2c93f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.803658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d34ff6-bc61-4770-8dfe-3df3d5b2c93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.809121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca5656-88c9-4e38-83c4-ba3331cc53dd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.819640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-00d34ff6-bc61-4770-8dfe-3df3d5b2c93f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:09.821078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-00d34ff6-bc61-4770-8dfe-3df3d5b2c93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:09.832347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:09.849062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:09.849790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:09.850147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:09.850433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:09.858765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:09.860287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:09.872541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:09.873472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:09.874413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 336/680] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:09.874958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.899635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 345/681] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:09.899635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d34ff6-bc61-4770-8dfe-3df3d5b2c93f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:09.985424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d40cf-c508-42fd-8ecd-ea66df57f0e6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:09.995056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:10.026488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.027490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.028053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.028479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.029376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=0621adefc6b340eba1ce85a4f64cae25) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:10.029856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.031561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.044037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 337/682] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/role_assignments?user.id=0621adefc6b340eba1ce85a4f64cae25&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:10.044903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d34ff6-bc61-4770-8dfe-3df3d5b2c93f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.045532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.091293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.091293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.091293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.091293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.107543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.111873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:10.133961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:10.135037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:10.136017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:10.143983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:10.144586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 346/683] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:10.145953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.208225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8f14-b713-472e-9266-d49f80659514 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.247572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.248219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.248529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.248837 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.249482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:10.249793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.251237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.265795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 338/684] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:10.269391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.313783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea9f9-6e13-49af-962c-f3f8d9064393 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.343964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:10.355216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.355876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.356399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.356680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.357581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:10.358055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.360811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.384361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 347/685] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Sep 5 10:26:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:10.385591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.405194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fc46-2a20-4e31-8444-747814ed2c4c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.408327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:10.450103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.450740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.451028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.451300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.461723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.463838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:10.479018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:10.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:10.482203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:10.482203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:10.482203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:10.482203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 339/686] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:10.482203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.505037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b0ebd-3806-4887-bad3-e0e2b2900186 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.544413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.545022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.545301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.545570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.546397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=e5f6af1603974cdba70d0d7d78e6777d) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:10.546737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.548320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.555058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 348/687] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:10 2022] GET /identity/v3/role_assignments?user.id=e5f6af1603974cdba70d0d7d78e6777d&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:10.555888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.611883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:10.614251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de175f-03b3-43ba-b756-b52461e405df None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.679236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11742660-9c8d-44d4-a697-e87def1410ef None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.696223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.697864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.698660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.699229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.718754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.723621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.723621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.723621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.723621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:10.723621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.723621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.737061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 349/688] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:10.742447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.765353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:10.832146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.833657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.880842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec9987-1c65-473d-b2f6-5d5d2b2cb96a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:10.891925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:10.920680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:10.921302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:10.921590 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:10.921871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:10.922650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:10.924279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:10.946464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 340/689] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:10.952678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:10.954729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 350/690] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:26:10 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:11.024118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:11.076470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0da3f8-df6a-4be1-8fbd-7d1a5422549a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:11.120379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:11.123786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:11.123786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:11.123786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:11.132993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:11.134523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:11.150817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:11.151889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:11.153380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:11.153380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:11.153380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:11.153380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 341/691] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:11.157541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:11.266313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d68f6-428b-46bc-84ff-5666810c63ef None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:11.306213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:11.307391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:11.307733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:11.308013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:11.308675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:11.308986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:11.310393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:11.324378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 351/692] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:11.329560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:11.458741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ef6c1-201c-415e-b18e-db257f91f788 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:11.474063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:11.508484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8e0fe-5d83-4c03-b4bd-05b7326d5dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:11.509172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e0fe-5d83-4c03-b4bd-05b7326d5dec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:11.510005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e0fe-5d83-4c03-b4bd-05b7326d5dec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:11.510392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e0fe-5d83-4c03-b4bd-05b7326d5dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:11.520613 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8e0fe-5d83-4c03-b4bd-05b7326d5dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:11.522093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8e0fe-5d83-4c03-b4bd-05b7326d5dec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-74a8e0fe-5d83-4c03-b4bd-05b7326d5dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:11.537363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:11.539402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:11.542090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 342/693] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:11.545145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:11.585454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:11.688810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd1181-75d6-4667-8ba0-ebe812d5c716 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:11.722779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f4f1f-a495-4ae5-a117-d0aa7a260e53 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:11.723163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f4f1f-a495-4ae5-a117-d0aa7a260e53 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:11.723427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f4f1f-a495-4ae5-a117-d0aa7a260e53 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:11.724413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:11.724869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 343/694] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:11.725139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:11.725420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:11.725692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:11.726392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:11.726693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:11.728701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:11.741821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 352/695] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:11.742895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c932-015e-4da7-a509-4b7682d2fcb3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:11.743182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c932-015e-4da7-a509-4b7682d2fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:11.743458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c932-015e-4da7-a509-4b7682d2fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:11.755614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:11.783530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f899c932-015e-4da7-a509-4b7682d2fcb3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:11.785101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f899c932-015e-4da7-a509-4b7682d2fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:11.848879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:11.868507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948b19-a690-448c-b5d6-d6c102dec026 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:11.932368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:11.933288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:11.933769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 344/696] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:11.934239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:11.934699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:11.935624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=e810111bda874bf2aa808991089c2197) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:11.936109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:11.937728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:11.945719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 353/697] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:11 2022] GET /identity/v3/role_assignments?user.id=e810111bda874bf2aa808991089c2197&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:12.264865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c932-015e-4da7-a509-4b7682d2fcb3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:12.373319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:12.377505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c932-015e-4da7-a509-4b7682d2fcb3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:12.417409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121eb69-40a9-479e-8de1-bc12f7861853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:12.418059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121eb69-40a9-479e-8de1-bc12f7861853 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:12.418344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121eb69-40a9-479e-8de1-bc12f7861853 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:12.418616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121eb69-40a9-479e-8de1-bc12f7861853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:12.429526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121eb69-40a9-479e-8de1-bc12f7861853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6121eb69-40a9-479e-8de1-bc12f7861853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:12.435042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:12.436007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:12.437147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 345/698] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:12.443854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:12.488417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645978-f55f-44fd-88d8-30a871b8aaf0 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:12.489079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645978-f55f-44fd-88d8-30a871b8aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:12.489079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67645978-f55f-44fd-88d8-30a871b8aaf0 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:12.490602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 346/699] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:12.500890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d3232-2af6-4abe-ba27-b578b9c44ff8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:12.501174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d3232-2af6-4abe-ba27-b578b9c44ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:12.501455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d3232-2af6-4abe-ba27-b578b9c44ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:12.525989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d42d3232-2af6-4abe-ba27-b578b9c44ff8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:12.527495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d42d3232-2af6-4abe-ba27-b578b9c44ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:12.570345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673e7f-8e24-4eb6-af59-95969a149180 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:12.611084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 347/700] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:26:12.624341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:12.624978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:12.625267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:12.625549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:12.626236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:12.626549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:12.628039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:12.638184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 354/701] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:12.644614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d3232-2af6-4abe-ba27-b578b9c44ff8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:12.758829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:12.771112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d3232-2af6-4abe-ba27-b578b9c44ff8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:12.808415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:12.809057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:12.809336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:12.809608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:12.820272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:12.821742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:12.837091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:12.839182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:12.840367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:12.840367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:12.840367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:12.840367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 348/702] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:12.848934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:12.861274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:12.963704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:12.965768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e00f-5b2a-4888-b9ff-7f4d27509c70 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:13.003935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:13.004873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.005444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.005873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.006669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:13.007123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:13.009106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:13.022622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 355/703] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:13.028369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:13.169454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:13.207039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e2eee-3e70-4dd6-8c06-468428e7e6c1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:13.238739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232680bb-e759-42b6-a0df-5738d942e6cc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:13.264396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:13.265030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.265312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.265587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.273375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:13.274855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:13.276684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6955612-9576-45fd-9b2d-657e1caa36ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:13.277585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6955612-9576-45fd-9b2d-657e1caa36ce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.278141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6955612-9576-45fd-9b2d-657e1caa36ce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.278622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6955612-9576-45fd-9b2d-657e1caa36ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.279401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6955612-9576-45fd-9b2d-657e1caa36ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:13.281024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6955612-9576-45fd-9b2d-657e1caa36ce None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a6955612-9576-45fd-9b2d-657e1caa36ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:13.293551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:13.294691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:13.295554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:13.298345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 349/704] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Sep 5 10:26:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:13.301105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539857db-647e-4d03-9ea0-876a2e067a8e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.301596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539857db-647e-4d03-9ea0-876a2e067a8e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.302103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539857db-647e-4d03-9ea0-876a2e067a8e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:13.302210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:13.303097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:13.304106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 356/705] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:26:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:13.304708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:13.307524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 350/706] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:13.309603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539857db-647e-4d03-9ea0-876a2e067a8e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:13.320381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:13.429889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539857db-647e-4d03-9ea0-876a2e067a8e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:13.446394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bcdf8-8b60-4601-bdc3-267ae823a09b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:13.469140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8043f-6807-48ae-8040-7afa22878c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:13.469798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8043f-6807-48ae-8040-7afa22878c2f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.470085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8043f-6807-48ae-8040-7afa22878c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.470365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8043f-6807-48ae-8040-7afa22878c2f None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.471103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8043f-6807-48ae-8040-7afa22878c2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:13.471410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8043f-6807-48ae-8040-7afa22878c2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:13.472894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8043f-6807-48ae-8040-7afa22878c2f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:13.485381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:13.492191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 351/707] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:26:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:13.493380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057eab8-b24e-4a8f-b147-3cdb06687530 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.494200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057eab8-b24e-4a8f-b147-3cdb06687530 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.494551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057eab8-b24e-4a8f-b147-3cdb06687530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.498153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:13.499136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.499649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.500193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.501050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:13.501863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:13.504507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:13.510985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 357/708] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Sep 5 10:26:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:13.512114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:13.516994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4057eab8-b24e-4a8f-b147-3cdb06687530 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:13.517389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4057eab8-b24e-4a8f-b147-3cdb06687530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:13.581613 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:13.600209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 352/709] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:13.600209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057eab8-b24e-4a8f-b147-3cdb06687530 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:13.632890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d618d-64a0-43e2-8c44-2a2d4d31f765 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:13.672333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:13.672943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.673221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.673495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.725194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057eab8-b24e-4a8f-b147-3cdb06687530 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:13.740656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:13.752010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:13.753695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:13.766396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b0596-58c4-496b-ad08-7a418c32e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:13.767253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b0596-58c4-496b-ad08-7a418c32e2cb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.767709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b0596-58c4-496b-ad08-7a418c32e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.768166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b0596-58c4-496b-ad08-7a418c32e2cb None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.768952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b0596-58c4-496b-ad08-7a418c32e2cb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:13.769401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b0596-58c4-496b-ad08-7a418c32e2cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:13.770895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b0596-58c4-496b-ad08-7a418c32e2cb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:13.784098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 353/710] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Sep 5 10:26:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:13.785752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8eb63-c6eb-4435-9a2b-cd89ca72a21b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.786211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8eb63-c6eb-4435-9a2b-cd89ca72a21b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.786638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8eb63-c6eb-4435-9a2b-cd89ca72a21b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.788424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 354/711] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:13.793877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5ad3-dc07-498d-9906-153ae9e86fdd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:13.794387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5ad3-dc07-498d-9906-153ae9e86fdd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:13.794832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5ad3-dc07-498d-9906-153ae9e86fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:13.830081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ee1b5ad3-dc07-498d-9906-153ae9e86fdd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:13.831549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ee1b5ad3-dc07-498d-9906-153ae9e86fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:13.873288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 358/712] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:13.881052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:13.945321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:13.987993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 355/713] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 10:26:13.988949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5ad3-dc07-498d-9906-153ae9e86fdd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.063233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:14.080296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec099390-5e67-4de3-ad45-c4c795a43eb4 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.160490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.163245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.166268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.166873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.198399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:14.200300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:14.222251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5ad3-dc07-498d-9906-153ae9e86fdd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:14.242843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:14.244593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:14.246124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:14.246124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:14.246124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:14.250593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 359/714] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:14.255251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.330365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.331482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.331988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.332476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] PATH_INFO: `/v3/services/network` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.333733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:14.336937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:14.348103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:14.349221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:14.350111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:14.352978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 356/715] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:13 2022] GET /identity/v3/services/network => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:14.354727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.403537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e40c63-73a0-4243-9dfb-2b2e9a3b4ec6 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.446803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.448164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.448514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.448772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.449426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:14.449727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:14.451117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:14.485859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 360/716] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:14.486770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.487487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:14.497240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:14.575549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec41f84-8c5a-4ab2-9f75-2f97c937259a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.620882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.621440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.621977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.622261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.632556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465acb-012c-4b39-a0ca-548d210b1773 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.636954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:14.642900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:14.644004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:14.644840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:14.647722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 357/717] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:14.648925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.675991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069080-6f8a-4ccd-8c59-b73a56b6a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.676961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069080-6f8a-4ccd-8c59-b73a56b6a199 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.677302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069080-6f8a-4ccd-8c59-b73a56b6a199 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.677655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069080-6f8a-4ccd-8c59-b73a56b6a199 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.678211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069080-6f8a-4ccd-8c59-b73a56b6a199 None admin] RBAC: Adding query filter params (name=network) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:14.678518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069080-6f8a-4ccd-8c59-b73a56b6a199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:14.679966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069080-6f8a-4ccd-8c59-b73a56b6a199 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:14.685060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 361/718] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:14.686302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fd48-fc6a-4678-b6d7-fb195488494d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.686590 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fd48-fc6a-4678-b6d7-fb195488494d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.686866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fd48-fc6a-4678-b6d7-fb195488494d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.688272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 362/719] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:14.692876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28fd48-fc6a-4678-b6d7-fb195488494d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.767501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64c792-7df6-4fc4-bae7-187d4be843a9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.769701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:14.779658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:14.803940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.804585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.804871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.805151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.808734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28fd48-fc6a-4678-b6d7-fb195488494d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.812587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:14.814040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:14.826077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:14.826993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 358/720] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:14.827932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.851236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016046d2-ebf9-457d-98cf-ffd3d6f969dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.851900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016046d2-ebf9-457d-98cf-ffd3d6f969dd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.852182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016046d2-ebf9-457d-98cf-ffd3d6f969dd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.852592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016046d2-ebf9-457d-98cf-ffd3d6f969dd None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.853911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016046d2-ebf9-457d-98cf-ffd3d6f969dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:14.854217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016046d2-ebf9-457d-98cf-ffd3d6f969dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:14.855612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016046d2-ebf9-457d-98cf-ffd3d6f969dd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:14.863873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 363/721] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:14.869489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5023-e71a-47d4-a59a-d3254d222c00 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.869701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5023-e71a-47d4-a59a-d3254d222c00 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.869979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5023-e71a-47d4-a59a-d3254d222c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.888350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-45dd5023-e71a-47d4-a59a-d3254d222c00 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:14.889462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-45dd5023-e71a-47d4-a59a-d3254d222c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:14.933027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a49e4-813a-4d31-a118-77fd495ed667 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:14.963494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 364/722] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:14.964391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5023-e71a-47d4-a59a-d3254d222c00 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:14.978838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:14.979777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:14.980260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:14.980709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:14.981508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] RBAC: Adding query filter params (type=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:14.981965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:14.983805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:14.989269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 359/723] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:14.990595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.028994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:15.032727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:15.135035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc410bb5-e273-4c9f-859e-7f3a94d196fc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.154058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5023-e71a-47d4-a59a-d3254d222c00 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.175272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.176319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.176768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.177308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.191475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:15.193240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:15.202448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.203078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.203363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.203682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.204402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:15.204703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:15.206151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:15.210844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:15.212021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:15.213178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:15.213178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:15.213178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:15.215084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 360/724] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:15.219444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 365/725] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:15.221401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.224865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.327297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:15.333131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a19aba-7830-4479-baae-66d44818e9fc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.348519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38992-9b6f-4f0e-aabb-df3739d47b59 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.355987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:15.375157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.376310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.376852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.377332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.378385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=bc87886676534d46bee21984a515c138) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:15.379023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:15.380709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:15.386970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.387606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.387912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.388179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.394043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:15.394043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:15.394043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:15.394664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 366/726] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/role_assignments?user.id=bc87886676534d46bee21984a515c138&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:15.395938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.408266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 361/727] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:15.409575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.587878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075b41-fba6-4f2e-b32e-d4f3c616efbb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.597786 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619320d-f423-422a-aac6-20c4f5c7ccbc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.629580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.630232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.630517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.630803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.638945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:15.640636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:15.641526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.642547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.643070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.643625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:15.654579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:15.655583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:15.656603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 362/728] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:15.657731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:15.663185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:15.664233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:15.665124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:15.667038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.667198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 367/729] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:15.673211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.679650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:15.731218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:15.793750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282202a-6300-4aa8-855a-40bc6fcc33b9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.832807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.833427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.833714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.834057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.834229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f1065-b477-45a8-bc9b-67788da813f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.834731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:15.835090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:15.836732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:15.848176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 368/730] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:15.853484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.872980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:15.872980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:15.872980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:15.873592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:15.873862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:15.874181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:15.875729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:15.914169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 363/731] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:15.920150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:15.979102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a740f9-64be-49ec-b57e-70d318e796e0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:15.987632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:16.021848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d262753-02e7-442f-92c8-20440ed19b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:16.022647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d262753-02e7-442f-92c8-20440ed19b21 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.022943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d262753-02e7-442f-92c8-20440ed19b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.023229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d262753-02e7-442f-92c8-20440ed19b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.037911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d262753-02e7-442f-92c8-20440ed19b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:16.040158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d262753-02e7-442f-92c8-20440ed19b21 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:16.041639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-6d262753-02e7-442f-92c8-20440ed19b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:16.058787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:16.060896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:16.062010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:16.062010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:16.062010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:16.062010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 369/732] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:16.065715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfced4-eceb-44c4-8cb9-ac453b35b114 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.067126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfced4-eceb-44c4-8cb9-ac453b35b114 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.067603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfced4-eceb-44c4-8cb9-ac453b35b114 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.072661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 370/733] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:16.073123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfced4-eceb-44c4-8cb9-ac453b35b114 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:16.100871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595960b-e584-4886-8863-af4fc73c0439 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:16.144138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:16.145039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.145537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.145960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.188467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfced4-eceb-44c4-8cb9-ac453b35b114 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:16.223268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:16.225041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:16.229594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b317719-222c-40d2-9abc-b7b3ca997c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:16.230216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317719-222c-40d2-9abc-b7b3ca997c19 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.230498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317719-222c-40d2-9abc-b7b3ca997c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.230774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317719-222c-40d2-9abc-b7b3ca997c19 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.231430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b317719-222c-40d2-9abc-b7b3ca997c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:16.231763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b317719-222c-40d2-9abc-b7b3ca997c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:16.233144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b317719-222c-40d2-9abc-b7b3ca997c19 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:16.251772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 371/734] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:16.251772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11661-b745-4b6d-bfb4-922c6783f107 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.251772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11661-b745-4b6d-bfb4-922c6783f107 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.251772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11661-b745-4b6d-bfb4-922c6783f107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.270060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-20c11661-b745-4b6d-bfb4-922c6783f107 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:16.271285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-20c11661-b745-4b6d-bfb4-922c6783f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:16.286579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:16.349196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 372/735] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:16.350067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c11661-b745-4b6d-bfb4-922c6783f107 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:16.461581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c11661-b745-4b6d-bfb4-922c6783f107 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:16.503772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:16.504408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.504691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.504969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.505711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:16.514378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:16.516055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:16.528672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:16.529866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:16.530978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:16.533175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 373/736] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:16.538238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:16.559969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:16.586757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 364/737] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:16.591858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:16.720934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a335d-5e1b-4023-b327-4f9587f41a4c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:16.761882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:16.762528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.762813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.763095 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.776003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60104ac2-b8f8-43c1-875e-98d5f8fd5d4c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:16.777300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:16.779766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:16.799282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:16.800321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:16.801222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:16.801222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:16.801222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:16.801405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 365/738] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:16.802644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:16.811285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:16.811947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.812233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.812513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.813382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:16.813693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:16.815283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:16.825298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:16.836872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 374/739] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Sep 5 10:26:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:16.838505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:16.921061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9924-dbf7-4b61-9a43-0a690465768e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:16.926210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:16.964329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40bae4-ec73-4468-84f9-9cedf6b5c862 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:16.974896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:16.975787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:16.976569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:16.977146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:16.978653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:16.981107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.008489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 366/740] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:16 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:17.008827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:17.017852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:17.018486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.018764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.019037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.020724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:17.020724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:17.028155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.053719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 375/741] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:17.054940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:17.179677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:17.226755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370676a9-8e37-47eb-b7ec-e9557d146e4c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:17.235373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56860bf-7fc4-42d4-bfb1-25b4411b822a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:17.262309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:17.272606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:17.273554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.274036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.274527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.275394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:17.276274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.276566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.276847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.283939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:17.285417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:17.299100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:17.300092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:17.300995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 376/742] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:17.307159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:17.355580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:17.357523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.414317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2653db8-9e23-4faf-8d5a-bf3ea1558729 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:17.447514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:17.454676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb6d8e-821c-4019-91e7-332b828b9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:17.455300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6d8e-821c-4019-91e7-332b828b9a42 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.455610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6d8e-821c-4019-91e7-332b828b9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.455895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6d8e-821c-4019-91e7-332b828b9a42 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.456777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6d8e-821c-4019-91e7-332b828b9a42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:17.457096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6d8e-821c-4019-91e7-332b828b9a42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:17.458678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6d8e-821c-4019-91e7-332b828b9a42 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.473222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 377/743] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:17.478250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a207-c8e4-48a5-a646-c5cc120f03b2 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.478250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a207-c8e4-48a5-a646-c5cc120f03b2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.478250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a207-c8e4-48a5-a646-c5cc120f03b2 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.478532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 367/744] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 10:26:17.480514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:17.480985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 378/745] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:17.488088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570faa5-9419-4c46-8189-b49a2c0cf186 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.488373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570faa5-9419-4c46-8189-b49a2c0cf186 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.488653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570faa5-9419-4c46-8189-b49a2c0cf186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.508945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c570faa5-9419-4c46-8189-b49a2c0cf186 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:17.510687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c570faa5-9419-4c46-8189-b49a2c0cf186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:17.568483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:17.584105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 379/746] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 05 10:26:17.584982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570faa5-9419-4c46-8189-b49a2c0cf186 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:17.611114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2a9e6-1528-4f36-a4d1-d23459550678 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:17.655352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f8da1-3f94-4d1f-b338-475ee3428c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:17.656256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8da1-3f94-4d1f-b338-475ee3428c59 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.656715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8da1-3f94-4d1f-b338-475ee3428c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.657148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f8da1-3f94-4d1f-b338-475ee3428c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.658022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f8da1-3f94-4d1f-b338-475ee3428c59 None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=5a06e8f4c38d42fe8e56c86a3834ec11) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:17.658522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f8da1-3f94-4d1f-b338-475ee3428c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:17.660167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f8da1-3f94-4d1f-b338-475ee3428c59 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.666407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 368/747] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:17 2022] GET /identity/v3/role_assignments?user.id=5a06e8f4c38d42fe8e56c86a3834ec11&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:17.667861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae170-017a-422a-8559-78affb24851c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.668370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae170-017a-422a-8559-78affb24851c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.668830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae170-017a-422a-8559-78affb24851c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.674733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 369/748] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:17.676516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5b29-a1d4-41f1-b897-8e0c6e8529a4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.677042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5b29-a1d4-41f1-b897-8e0c6e8529a4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.677540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5b29-a1d4-41f1-b897-8e0c6e8529a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.697167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ffdd5b29-a1d4-41f1-b897-8e0c6e8529a4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:17.698944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffdd5b29-a1d4-41f1-b897-8e0c6e8529a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:17.699089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570faa5-9419-4c46-8189-b49a2c0cf186 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:17.739428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:17.740067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:17.740182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.740420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.740700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.752589 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:17.754104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:17.779190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:17.780692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:17.781587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:17.781587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:17.781587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:17.782908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 370/749] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 10:26:17.787735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 380/750] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:17.791010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5b29-a1d4-41f1-b897-8e0c6e8529a4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:17.929212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5b29-a1d4-41f1-b897-8e0c6e8529a4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:17.960957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:17.968969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:17.974222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:17.974735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:17.975229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:17.976137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:17.976651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:17.978796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:17.997364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 371/751] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:18.002488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:18.012727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:18.071510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:18.119342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40eaeaf-57ab-401b-9e51-f74eee65977c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:18.162672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:18.163365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:18.163676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:18.163956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:18.173471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:18.175079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:18.189084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:18.190002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:18.190889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 372/752] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:18.197374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:18.200388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089607-5fa4-45b8-ba2e-47dafff6c5a8 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:18.245343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:18.246271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:18.246556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:18.246836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:18.247566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:18.249046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:18.268482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 381/753] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:17 2022] POST /identity/v3/services => generated 240 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:26:18.269655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:18.356564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:18.375034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656419-0f92-4602-ab21-f8d084e79c46 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:18.447901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:18.448541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:18.448829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:18.449105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:18.449804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:18.450111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:18.451606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:18.451936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:18.467764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 373/754] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:18.475896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c20a8-d9b1-4331-916e-21b1b0b3a0ca None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:18.476151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:18.518488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:18.519413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:18.519940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:18.520389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:18.533448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:18.539798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:18.541717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:18.542631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:18.544853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 382/755] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:18.551936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:18.604524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe183d-39f5-4d2c-9e6f-96356647c11d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:18.675729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f45b6-c829-4cda-9021-6a0844cac3d3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:18.687296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:18.687958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:18.688243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:18.688522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:18.689257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=e810111bda874bf2aa808991089c2197) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:18.689837 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:18.691286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:18.704460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 374/756] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:18 2022] GET /identity/v3/role_assignments?user.id=e810111bda874bf2aa808991089c2197&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:18.725107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:18.725806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:18.726092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:18.726370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:18.727114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:18.727427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:18.729441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:18.744180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 383/757] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:18.746642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:18.760987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:18.861939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132b359-8b19-4a1a-9c7a-963a587ea756 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:18.902502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:18.903169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:18.903458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:18.903780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:18.916631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:18.918106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:18.933702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:18.935631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:18.937866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:18.937866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:18.937866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:18.939480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 375/758] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:18.940817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:18.951233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:19.049795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b6d9-0716-4a87-97ed-d7293c731b1d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:19.085552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:19.086171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.086458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.086737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.088260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:19.088597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:19.090129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:19.106660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 384/759] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:19.112548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:19.184626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:19.225701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd0b1a-17ff-47b8-8738-1e2253ce5593 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:19.271012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:19.271663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.272093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.272372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.281446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:19.282900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:19.303973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:19.306795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:19.309209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 376/760] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:26:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:19.311620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:19.414987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:19.457871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1ac6f-d94a-4e7d-aea1-a853576ad80f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:19.501894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b65ba8-9c30-4761-ad0a-ffdc4e995047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:19.502520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65ba8-9c30-4761-ad0a-ffdc4e995047 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.502806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65ba8-9c30-4761-ad0a-ffdc4e995047 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.503086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65ba8-9c30-4761-ad0a-ffdc4e995047 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.503862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65ba8-9c30-4761-ad0a-ffdc4e995047 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:19.504177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65ba8-9c30-4761-ad0a-ffdc4e995047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:19.505625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b65ba8-9c30-4761-ad0a-ffdc4e995047 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:19.529564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 385/761] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:26:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:19.530964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:19.660409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c5a7-fa46-4a17-9e02-e425cb4a5583 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:19.692809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:19.707726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:19.708368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.708725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.709007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.722043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cef019-3810-4d88-a029-60e503b32caa None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.722320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cef019-3810-4d88-a029-60e503b32caa None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.722604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cef019-3810-4d88-a029-60e503b32caa None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.723959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 386/762] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:19.726680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:19.728423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:19.731995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ac2e-61f3-4e29-bc4e-cddaa1093800 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.732281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ac2e-61f3-4e29-bc4e-cddaa1093800 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.732561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ac2e-61f3-4e29-bc4e-cddaa1093800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.760593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-fd75ac2e-61f3-4e29-bc4e-cddaa1093800 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:19.761805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fd75ac2e-61f3-4e29-bc4e-cddaa1093800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:19.766240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:19.767183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:19.768111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:19.768111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:19.768111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:19.772663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 377/763] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:19.779530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:19.902333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 387/764] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:19.912915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05480c-8b0d-433a-a927-833c9faba4f1 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.913205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05480c-8b0d-433a-a927-833c9faba4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.913486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05480c-8b0d-433a-a927-833c9faba4f1 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.915019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 388/765] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:19.920248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591f0f-01c4-4748-963b-083fe52d770f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:19.920536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591f0f-01c4-4748-963b-083fe52d770f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:19.921390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34591f0f-01c4-4748-963b-083fe52d770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:19.940845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-34591f0f-01c4-4748-963b-083fe52d770f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:19.942065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-34591f0f-01c4-4748-963b-083fe52d770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:19.945056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e50e8-3d52-486c-9457-5b379e85857a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:19.995124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:20.020443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.021060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.021343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.021618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.022270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:20.022577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:20.023969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:20.029650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 389/766] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:20.044790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 378/767] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:20.050194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34591f0f-01c4-4748-963b-083fe52d770f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.197704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34591f0f-01c4-4748-963b-083fe52d770f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:20.202400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.238920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.239955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.240445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.240922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.249639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:20.250516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:20.252627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:20.268063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:20.269078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:20.270074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:20.276562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 390/768] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:20.279196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.332364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:20.388815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78096c03-7da3-40a7-bb70-8f5434839278 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:20.416229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2583899-5743-490a-b058-7f8f3a1fa299 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:20.435972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.436884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.437172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.437447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.438037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:20.440083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:20.452824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:20.453821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:20.455813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 379/769] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:20.456617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.465463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.466944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.467459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.468481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.469825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:20.470356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:20.472575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:20.496010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 391/770] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:20.496010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.592523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:20.597961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a93d34-3663-470a-80e8-8847bc51e020 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:20.615482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f1790-d7a3-4418-a42b-7522a9a56737 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:20.619910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:20.649920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.651674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.652283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.652780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.656186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.656869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.657255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.657632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.658387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:20.658794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:20.660422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:20.666374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 392/771] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:20.666813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:20.667469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:20.673927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:20.675041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:20.676085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:20.683479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 380/772] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:20.683479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.785447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da0911-59ba-4acd-a0c5-56d76f90e372 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:20.804521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92f06-d310-4bbb-ac1e-c9541b78b8f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:20.823040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.823909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.824299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.824687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/bc87886676534d46bee21984a515c138/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.826821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=bc87886676534d46bee21984a515c138, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:20.828421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:20.847135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:20.848097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:20.848571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:20.849025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:20.849896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:20.850372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:20.851686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 393/773] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:20 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/bc87886676534d46bee21984a515c138/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:20.852316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:20.853404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.862884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 381/774] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:20.870843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:20.898938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:20.908186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:21.001201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6bfb8-eb10-49df-aa49-f4a45fe82392 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.004922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af47f-34ef-4157-a8dc-aefcd13a88d2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.039189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ee62e-77ae-42f9-a5e2-ad21685d091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.039525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ee62e-77ae-42f9-a5e2-ad21685d091a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.039798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ee62e-77ae-42f9-a5e2-ad21685d091a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.040078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ee62e-77ae-42f9-a5e2-ad21685d091a None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.041588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ee62e-77ae-42f9-a5e2-ad21685d091a None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:21.041889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ee62e-77ae-42f9-a5e2-ad21685d091a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.043218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ee62e-77ae-42f9-a5e2-ad21685d091a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.046059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e9420-cb71-4ab4-b826-4dbfccc0aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.046532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9420-cb71-4ab4-b826-4dbfccc0aa1f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.046812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9420-cb71-4ab4-b826-4dbfccc0aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.047091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9420-cb71-4ab4-b826-4dbfccc0aa1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.047821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e9420-cb71-4ab4-b826-4dbfccc0aa1f None admin] RBAC: Adding query filter params (interface=public, service_id=f60dc8920fbc4006bffa76aff654cce9, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:21.048130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e9420-cb71-4ab4-b826-4dbfccc0aa1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.049484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e9420-cb71-4ab4-b826-4dbfccc0aa1f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.056726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 394/775] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:21.057349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d11b02-a391-4ace-a91b-c7b9e7af9d5d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.057639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d11b02-a391-4ace-a91b-c7b9e7af9d5d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.057916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d11b02-a391-4ace-a91b-c7b9e7af9d5d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.059266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 395/776] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:21.061592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d11b02-a391-4ace-a91b-c7b9e7af9d5d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.063969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 382/777] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:26:20 2022] GET /identity/v3/endpoints?service_id=f60dc8920fbc4006bffa76aff654cce9&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:21.065335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee013-713a-4fbe-bf9e-c4c752a8dcc9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.065626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee013-713a-4fbe-bf9e-c4c752a8dcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.065903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee013-713a-4fbe-bf9e-c4c752a8dcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.088075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1f5ee013-713a-4fbe-bf9e-c4c752a8dcc9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:21.088075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1f5ee013-713a-4fbe-bf9e-c4c752a8dcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:21.177098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 383/778] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:21.178894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee013-713a-4fbe-bf9e-c4c752a8dcc9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.187267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:21.198691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:21.205308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d11b02-a391-4ace-a91b-c7b9e7af9d5d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.243049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5398a-0fd1-438d-87f3-d5ccd3d9beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.244323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5398a-0fd1-438d-87f3-d5ccd3d9beae None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.244609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5398a-0fd1-438d-87f3-d5ccd3d9beae None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.244879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5398a-0fd1-438d-87f3-d5ccd3d9beae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.256652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5398a-0fd1-438d-87f3-d5ccd3d9beae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.258171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5398a-0fd1-438d-87f3-d5ccd3d9beae None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a5a5398a-0fd1-438d-87f3-d5ccd3d9beae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:21.274370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:21.275864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:21.276790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:21.276790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:21.276790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:21.280003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 396/779] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:21.281207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60edfd9-6139-4fa5-b844-38e7b0b8061a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.281604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60edfd9-6139-4fa5-b844-38e7b0b8061a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.281889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60edfd9-6139-4fa5-b844-38e7b0b8061a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.284653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 397/780] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:21.285373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60edfd9-6139-4fa5-b844-38e7b0b8061a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.285842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee013-713a-4fbe-bf9e-c4c752a8dcc9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.322085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d652-7e71-47b1-96bb-b790e2696793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.322762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d652-7e71-47b1-96bb-b790e2696793 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.323140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d652-7e71-47b1-96bb-b790e2696793 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.323511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d652-7e71-47b1-96bb-b790e2696793 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.324243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d652-7e71-47b1-96bb-b790e2696793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.325754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d652-7e71-47b1-96bb-b790e2696793 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.335532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 384/781] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:21.335532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3442f3e-b9af-4b4f-9eac-1c58f50fd6d2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.335532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3442f3e-b9af-4b4f-9eac-1c58f50fd6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.335532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3442f3e-b9af-4b4f-9eac-1c58f50fd6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.369874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3442f3e-b9af-4b4f-9eac-1c58f50fd6d2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:21.371541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3442f3e-b9af-4b4f-9eac-1c58f50fd6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:21.462118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60edfd9-6139-4fa5-b844-38e7b0b8061a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.466879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 385/782] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:21.504828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3442f3e-b9af-4b4f-9eac-1c58f50fd6d2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.518808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:21.519925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.520553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.520840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.521120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.521782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:21.522088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.524337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.538032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 398/783] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:21.544735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.596029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:21.619562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3442f3e-b9af-4b4f-9eac-1c58f50fd6d2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.661215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.661895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.662144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae62c31-d62f-40a9-9f03-a131ba3f28f9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.662252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.662432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] PATH_INFO: `/v3/services/network` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.663012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.664468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:21.674503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:21.675508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:21.676379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 386/784] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:21.682499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.705955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.706593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.706871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.707148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.716064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.717514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:21.731468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:21.732516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:21.733493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 399/785] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:21.745003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.782129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:21.822964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1773a-c0e1-4b24-8087-aa7e40270943 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.843284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:21.872343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.872868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.873148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.873419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.874049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:21.874354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.876080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.884361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 387/786] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:21.885621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:21.895321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432239-34a0-442d-847a-48264e10af5f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:21.933154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:21.933815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:21.934109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:21.934386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:21.935128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:21.935482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:21.937133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:21.956418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 400/787] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:21.957447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.007738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8535d6-da72-4fb7-8205-cd710ea2e856 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.050152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.050795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.051082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.051359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.059081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:22.064663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:22.070102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:22.071025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:22.072620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 388/788] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:22.077985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.084690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87efba3-d1b1-4fd7-9433-078936dd1a6d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.113886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:22.136798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.137411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.137689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.137961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.139050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] RBAC: Adding query filter params (type=network) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:22.139359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.141194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.151242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 401/789] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:22.151645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.224256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c752f-344e-4bbb-a044-aab64f8a48be None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.261700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.262339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.262618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.262889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.273442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.275135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.281504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79772e51-91e7-4104-89dc-006cfba8b93e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:22.289337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:22.290845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:22.292119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:22.292119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:22.292119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:22.292119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 389/790] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:22.292398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.322605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.323608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.324156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.324585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.325404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:22.325860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.327676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.337733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 402/791] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:22.338967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.346144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:22.394926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:22.396027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42749b-5761-4169-bce8-a72ad4f4ff1d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.432704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.433541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.433674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.433859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.434641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] RBAC: Adding query filter params (interface=public, service_id=67f0f2c5648e4a8c90632aa6005db2d3, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:22.435005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.436719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.443666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 390/792] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/endpoints?service_id=67f0f2c5648e4a8c90632aa6005db2d3&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:22.443666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.464004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde59b7-dc62-4d18-8f0d-990b43af44fc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.502315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f063927-c638-4943-a332-43a31707645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.503157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f063927-c638-4943-a332-43a31707645a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.503541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f063927-c638-4943-a332-43a31707645a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.503951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f063927-c638-4943-a332-43a31707645a None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.504813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f063927-c638-4943-a332-43a31707645a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:22.505224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f063927-c638-4943-a332-43a31707645a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.506816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f063927-c638-4943-a332-43a31707645a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.527615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 403/793] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:22.527615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f063927-c638-4943-a332-43a31707645a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.567025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292615eb-56ce-4f96-9f00-812b87c42131 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.582300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:22.605755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.606637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.607072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.607499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.620900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.622691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:22.639077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:22.640352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:22.641364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:22.641364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:22.641364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:22.643434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 391/794] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:22.644618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.655195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f063927-c638-4943-a332-43a31707645a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.664855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:22.697048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.697842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.698125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.698401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.699014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.700469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.711624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 404/795] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:22.711624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.789154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aaab6-afcd-4568-9356-db096757395f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.828604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.830090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.830656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.831160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.839185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.839405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e768e3-97f5-461b-982c-eccf979dedcc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:22.841259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:22.856160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:22.857133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:22.858039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:22.860460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 392/796] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:22.872103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.891074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:22.891074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:22.891074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:22.891074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:22.891522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:22.891522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:22.891522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:22.906545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 405/797] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:22.909175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:22.914683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:22.973576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:23.015374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85800-0412-4044-89b0-f1300e1bec55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.061055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcaa58-50d9-437c-bcdd-744dd7199654 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.061364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09e52c-cd44-4daa-afb8-55d3466fc6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.062007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09e52c-cd44-4daa-afb8-55d3466fc6de None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.062295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09e52c-cd44-4daa-afb8-55d3466fc6de None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.062569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09e52c-cd44-4daa-afb8-55d3466fc6de None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.063297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09e52c-cd44-4daa-afb8-55d3466fc6de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:23.064450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09e52c-cd44-4daa-afb8-55d3466fc6de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:23.065910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09e52c-cd44-4daa-afb8-55d3466fc6de None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:23.079460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 393/798] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:23.081060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4629e-020e-4681-af42-e254edf4e3e8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.081544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4629e-020e-4681-af42-e254edf4e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.082018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4629e-020e-4681-af42-e254edf4e3e8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.087756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 394/799] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:23.088958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4629e-020e-4681-af42-e254edf4e3e8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:23.112320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f5239-76a0-4372-9ea4-e75320c84ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.112963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5239-76a0-4372-9ea4-e75320c84ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.113242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5239-76a0-4372-9ea4-e75320c84ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.113520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5239-76a0-4372-9ea4-e75320c84ad7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.127687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f5239-76a0-4372-9ea4-e75320c84ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:23.130265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f5239-76a0-4372-9ea4-e75320c84ad7 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-815f5239-76a0-4372-9ea4-e75320c84ad7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:23.146239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:23.147248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:23.148248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:23.151661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 406/800] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:23.153900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b913d-414b-456d-9d3e-fd52e2bc9c82 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.154180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b913d-414b-456d-9d3e-fd52e2bc9c82 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.154450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b913d-414b-456d-9d3e-fd52e2bc9c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.173557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c93b913d-414b-456d-9d3e-fd52e2bc9c82 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:23.174649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c93b913d-414b-456d-9d3e-fd52e2bc9c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:23.209986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:23.234076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4629e-020e-4681-af42-e254edf4e3e8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.255810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 407/801] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:23.256742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b913d-414b-456d-9d3e-fd52e2bc9c82 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:23.282079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.284466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.284954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.285758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/5a06e8f4c38d42fe8e56c86a3834ec11/roles/c1bfa1f1c0a34c94b82d6269e57d15e5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.304768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:23.320589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=5a06e8f4c38d42fe8e56c86a3834ec11, role_id=c1bfa1f1c0a34c94b82d6269e57d15e5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:23.323377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:23.347993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 395/802] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:23 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/5a06e8f4c38d42fe8e56c86a3834ec11/roles/c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:23.420294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b913d-414b-456d-9d3e-fd52e2bc9c82 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.469617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.470602 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.471084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.471619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.472580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:23.473112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:23.474802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:23.500122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 408/803] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Sep 5 10:26:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:23.506091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:23.559249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:23.637957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43933b69-6994-4cd5-9f95-0118ba0c2f57 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.678213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.679345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.679928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.681313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.684370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:23.694252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:23.694993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:23.701208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:23.716508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:23.717502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:23.718389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:23.718389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:23.718389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:23.718389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 396/804] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:23.723149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:23.747436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c3ba-f255-488f-959d-d7f86559ba1c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.785156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5eb8e-092b-43e0-bf2b-98a09f8b58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.785875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5eb8e-092b-43e0-bf2b-98a09f8b58cf None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.786166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5eb8e-092b-43e0-bf2b-98a09f8b58cf None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.786450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5eb8e-092b-43e0-bf2b-98a09f8b58cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.797661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5eb8e-092b-43e0-bf2b-98a09f8b58cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-fff5eb8e-092b-43e0-bf2b-98a09f8b58cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:23.803398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:23.804367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:23.805203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 409/805] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:23.807055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc19d2-0930-4d71-a0d4-ac45f5c8220b None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.807225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc19d2-0930-4d71-a0d4-ac45f5c8220b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.811639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc19d2-0930-4d71-a0d4-ac45f5c8220b None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.814440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 410/806] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:23.815405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc19d2-0930-4d71-a0d4-ac45f5c8220b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:23.856243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f85ea-f952-47b3-a0ac-ab9c088e2811 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.899306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ca900-aae2-4969-9107-69538fcb924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.900514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ca900-aae2-4969-9107-69538fcb924a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.900961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ca900-aae2-4969-9107-69538fcb924a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.901240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ca900-aae2-4969-9107-69538fcb924a None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.902679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ca900-aae2-4969-9107-69538fcb924a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:23.903047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ca900-aae2-4969-9107-69538fcb924a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:23.904466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ca900-aae2-4969-9107-69538fcb924a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:23.920655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 397/807] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:23.922401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59a8d-fb26-46d0-af1e-f1bc0c20cbb6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.922764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59a8d-fb26-46d0-af1e-f1bc0c20cbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.923116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59a8d-fb26-46d0-af1e-f1bc0c20cbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.943271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc19d2-0930-4d71-a0d4-ac45f5c8220b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:23.947836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-13d59a8d-fb26-46d0-af1e-f1bc0c20cbb6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:23.949256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-13d59a8d-fb26-46d0-af1e-f1bc0c20cbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:23.983863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:23.984844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:23.985298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:23.985791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:23.986635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:23.987159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:23.988818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:23.995205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:24.005249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 411/808] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:24.006492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.011720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:24.043118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 398/809] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:24.044522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d59a8d-fb26-46d0-af1e-f1bc0c20cbb6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.176391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9cad4-5610-4e23-a9d3-91316cb382b6 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.189176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d59a8d-fb26-46d0-af1e-f1bc0c20cbb6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.228525 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:24.229903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:24.230628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:24.231081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:24.237594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:24.238230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:24.238580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:24.238926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:24.244698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:24.247023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:24.247137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:24.248583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:24.263450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:24.264475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:24.265362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:24.265362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:24.265362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:24.267231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 399/810] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:24.271619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:24.272495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:24.273383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:24.275934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 412/811] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:24.281869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.282350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.339859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:24.371976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:24.418603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9470d02-7c71-4ec8-b500-d988e0f6de67 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.420979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9b9c8-0aac-4dcc-b350-c07efe483761 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.460304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:24.460911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:24.461198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:24.461476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:24.462672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:24.462986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:24.464008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:24.464795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:24.464912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:24.465259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:24.465627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:24.466700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:24.467658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:24.469191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:24.477156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 400/812] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:24.478123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.487358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 413/813] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:24.488308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.594808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:24.605943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd238-fdaa-4bc3-aed8-751dd21f1334 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.612401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465f18-da3e-4afb-bbe3-f459eee02efd None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.636897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:24.646669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:24.647787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:24.648306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:24.648724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:24.649993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:24.651786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:24.654115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:24.654870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:24.655424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:24.655734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:24.662557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:24.663762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 10:26:24.664835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:24.666347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:24.668186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:24.672318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 401/814] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:24.672825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:24.685796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:24.686966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:24.688176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:24.694353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 414/815] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:24.695314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.791762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d92b5-a886-4b8f-9c06-14d0c91009b9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.830500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:24.831548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:24.832018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:24.832534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/e810111bda874bf2aa808991089c2197/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:24.834840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=e810111bda874bf2aa808991089c2197, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:24.836608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:24.854068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 402/816] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:24 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/e810111bda874bf2aa808991089c2197/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:24.855272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:24.876034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:24.976350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f343c-2b71-418d-bf17-8f7b6846c0f8 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:24.997066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c20689-7695-4598-9f8c-6cab1bc3d4b9 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:25.015904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:25.016757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.017210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.017666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.018541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:25.019000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:25.020623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:25.046016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 403/817] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:25.047846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:25.066341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:25.066967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.067576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.067805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.068514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:25.068823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:25.070328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:25.081989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 415/818] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Sep 5 10:26:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:25.102258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:25.141608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:25.166841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:25.185221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d19736-f629-409b-8469-e5cf0ee25005 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:25.227142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a79a3a-33f6-4a8a-81f4-c396715204d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:25.228014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a79a3a-33f6-4a8a-81f4-c396715204d8 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.228298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a79a3a-33f6-4a8a-81f4-c396715204d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.228689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a79a3a-33f6-4a8a-81f4-c396715204d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.247951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86867a1b-5dd9-41a6-862e-0a80ee890aac None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:25.299290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302abaeb-c844-47ac-8559-049337ca912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:25.300421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abaeb-c844-47ac-8559-049337ca912c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.301549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abaeb-c844-47ac-8559-049337ca912c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.302008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abaeb-c844-47ac-8559-049337ca912c None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.303074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302abaeb-c844-47ac-8559-049337ca912c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:25.303513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a79a3a-33f6-4a8a-81f4-c396715204d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:25.303714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302abaeb-c844-47ac-8559-049337ca912c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:25.305142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a79a3a-33f6-4a8a-81f4-c396715204d8 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:25.305372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302abaeb-c844-47ac-8559-049337ca912c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:25.312373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 416/819] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Sep 5 10:26:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:25.313847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46d4c-312a-44eb-9c83-67aad5a6f52e None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.314815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46d4c-312a-44eb-9c83-67aad5a6f52e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.315250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46d4c-312a-44eb-9c83-67aad5a6f52e None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.317170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 417/820] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:25.318452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46d4c-312a-44eb-9c83-67aad5a6f52e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:25.392127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:25.434189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 404/821] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:26:25.435498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db469-28b6-4eac-9907-80407a2dc119 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.435817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db469-28b6-4eac-9907-80407a2dc119 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.436102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db469-28b6-4eac-9907-80407a2dc119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.453942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46d4c-312a-44eb-9c83-67aad5a6f52e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:25.457689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d57db469-28b6-4eac-9907-80407a2dc119 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:25.458949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d57db469-28b6-4eac-9907-80407a2dc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:25.466201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:25.500853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:25.501648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.502027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.502649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.504346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:25.505850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:25.533755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 418/822] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:25.534657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:25.554759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 405/823] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:25.557225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820021-9fab-42a6-96b3-c5a11df60acf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.557712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820021-9fab-42a6-96b3-c5a11df60acf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.558137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820021-9fab-42a6-96b3-c5a11df60acf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.559812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 406/824] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:25.564969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a08c2-033e-4736-95a4-96b8ca773047 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.565534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a08c2-033e-4736-95a4-96b8ca773047 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.566013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a08c2-033e-4736-95a4-96b8ca773047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.587464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b93a08c2-033e-4736-95a4-96b8ca773047 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:25.589550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b93a08c2-033e-4736-95a4-96b8ca773047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:25.714983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 407/825] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:25.720753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8c0f-2bbc-44ac-b1b3-56cf65434310 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:25.766989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:25.767655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.767936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.768208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.779345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:25.780868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:25.796652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:25.797630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:25.798723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:25.798723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:25.798723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:25.798723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 419/826] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:25.805233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a08c2-033e-4736-95a4-96b8ca773047 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:25.845390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:25.890968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:25.913546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:25.926479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a08c2-033e-4736-95a4-96b8ca773047 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:25.970842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:25.971457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:25.971797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:25.972079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:25.972716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:25.973175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:25.975143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:25.997416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 408/827] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:25.999007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.019767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd950e-3dde-47e5-8c89-ce8d7d8c3abd None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.056840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.057588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.057864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.058130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] PATH_INFO: `/v3/services/network` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.058717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.060124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:26.069831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:26.070872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:26.072758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 420/828] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:25 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:26.073599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.110325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:26.119348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec08644-c6b3-46ee-a00c-fd7e24725b3e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.163388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.164758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.165377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.166123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.167068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:26.175117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.177029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:26.190329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:26.191410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:26.192548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:26.193375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782b0b3-44fe-40fa-a187-1fa8ba8c1f5b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.194263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 409/829] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:26.195219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.240469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.241485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.242504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.242971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.257711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:26.266377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:26.267498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:26:26.268578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:26.275890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 421/830] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:26.275890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.326631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24955417-cfc7-416c-82fc-194c5379b97a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.366286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.367032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.367412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.367824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.369217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] RBAC: Adding query filter params (name=network) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:26.369833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.371577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.376875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 410/831] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:26.377861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.396721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:26.408414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f5404-ca07-45e5-94f4-25bbc38ba712 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.450289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.451044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.451425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.451856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.452667 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:26.453150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.454675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.467075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:26.471720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 422/832] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:26.473130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.505441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3ac9c-8f09-4650-a261-dc7ef4fa9415 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.543184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.544007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.544362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.544733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.545500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:26.545928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.547489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.555801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 411/833] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:26.557512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.604206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4f126-06a0-47a9-ab4c-7415409e6b77 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.645988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.646608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:26.646846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.647628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.647989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.648870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:26.649274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.651971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.657998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 423/834] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:26.658970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.681347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cada9-46c9-49c0-a52d-6683e89f7d8c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.728190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:26.732853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.733777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.734938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.735620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.737045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=bc87886676534d46bee21984a515c138) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:26.737508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.739685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.749195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 412/835] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/role_assignments?user.id=bc87886676534d46bee21984a515c138&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:26.750770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.779485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f78fa-a6e9-415a-9ec6-438dc14debc4 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.827404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.828258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.828632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.828998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.841462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.843143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:26.872673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:26.873835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:26.874747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:26.874747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:26.874747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:26.883031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 424/836] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:26.889410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:26.916554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9b37-c44f-44ac-8ef6-b7d0bb29d336 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:26.960358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:26.961681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:26.962739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:26.963315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:26.964287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:26.965832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:26.975750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:26.992785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 413/837] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:27.056924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a8338-ee4d-4666-ab77-d7af8a4528c3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:27.075838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:27.107037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e3ab4-9625-4379-a7d7-c0e904990236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:27.107678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e3ab4-9625-4379-a7d7-c0e904990236 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.107962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e3ab4-9625-4379-a7d7-c0e904990236 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.108239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e3ab4-9625-4379-a7d7-c0e904990236 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.108889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e3ab4-9625-4379-a7d7-c0e904990236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:27.109192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e3ab4-9625-4379-a7d7-c0e904990236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:27.110587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e3ab4-9625-4379-a7d7-c0e904990236 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:27.129530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 425/838] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:27.136773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:27.199237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f6805-c22d-460e-ba93-5f1cd0152751 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.199578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f6805-c22d-460e-ba93-5f1cd0152751 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.199827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f6805-c22d-460e-ba93-5f1cd0152751 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.201430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 426/839] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:27.206658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8aac-3c41-4105-b91c-ed2638233488 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.206940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8aac-3c41-4105-b91c-ed2638233488 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.207209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8aac-3c41-4105-b91c-ed2638233488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.229951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e13a8aac-3c41-4105-b91c-ed2638233488 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:27.231156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e13a8aac-3c41-4105-b91c-ed2638233488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:27.263673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6b64-a9cb-4725-b45f-bc07680e6940 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:27.306136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:27.307249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.307783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.308260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.311905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 427/840] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:27.317466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:27.319216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:27.331794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:27.332756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:27.333710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:27.336322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 414/841] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:26:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:27.342686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8aac-3c41-4105-b91c-ed2638233488 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:27.455731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8aac-3c41-4105-b91c-ed2638233488 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:27.457241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:27.491958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:27.492581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.492864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.493174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.494447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:27.494752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:27.496476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:27.519711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 428/842] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Sep 5 10:26:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:27.521219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:27.588333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:27.635350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:27.640605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48421001-d8bf-4017-869b-5c2cb193ff7a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:27.676509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc61528-2cbc-439a-9057-7ed1c6322a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:27.677461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc61528-2cbc-439a-9057-7ed1c6322a00 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.678038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc61528-2cbc-439a-9057-7ed1c6322a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.678513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc61528-2cbc-439a-9057-7ed1c6322a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.738602 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a90f-0e4e-42d4-80da-a9fa754d6cd1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:27.751662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc61528-2cbc-439a-9057-7ed1c6322a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:27.753436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc61528-2cbc-439a-9057-7ed1c6322a00 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:27.775452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:27.776131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.776411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.776685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.787359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:27.792369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:27.793311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:27.794159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 429/843] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:27.800487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:27.824032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:27.829124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:27.869288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 415/844] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:26:27.871209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174dae3-957a-49d5-bb46-574390348cca None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.871559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174dae3-957a-49d5-bb46-574390348cca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.871926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174dae3-957a-49d5-bb46-574390348cca None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.873377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 416/845] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:27.876458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174dae3-957a-49d5-bb46-574390348cca None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:27.916509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daabc2-53e4-4648-b242-b24f77d6628c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:27.953864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27627d0c-a34b-4418-a98f-22b360820845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:27.954929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627d0c-a34b-4418-a98f-22b360820845 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.955388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627d0c-a34b-4418-a98f-22b360820845 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.955908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27627d0c-a34b-4418-a98f-22b360820845 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.956799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27627d0c-a34b-4418-a98f-22b360820845 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:27.957280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27627d0c-a34b-4418-a98f-22b360820845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:27.958946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27627d0c-a34b-4418-a98f-22b360820845 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:27.968796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 430/846] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:27.970409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a9d5-e5ca-4893-a246-46bc74ef1884 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:27.970696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a9d5-e5ca-4893-a246-46bc74ef1884 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:27.970970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a9d5-e5ca-4893-a246-46bc74ef1884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:27.984220 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174dae3-957a-49d5-bb46-574390348cca None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:27.990556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2356a9d5-e5ca-4893-a246-46bc74ef1884 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:27.991733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2356a9d5-e5ca-4893-a246-46bc74ef1884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:28.022176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.022806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.023091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.023366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.034518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.036068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:28.052024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:28.053019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:28.053922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:28.053922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:28.053922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:28.053922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 417/847] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:28.053922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.064539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.079731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 431/848] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:28.080844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356a9d5-e5ca-4893-a246-46bc74ef1884 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.100282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.186472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc8f57-04a6-4ffc-9a9f-068b06540572 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.222040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356a9d5-e5ca-4893-a246-46bc74ef1884 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.222846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.223849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.224430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.224925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.236978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.238903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:28.255248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:28.256275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:28.257189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:28.257189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:28.257189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:28.259443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 418/849] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:28.261446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.262061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.262343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.262618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.263260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:28.263562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.264920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.265103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.283489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 432/850] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:28.284621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.345620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.369938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.390713 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da027b26-d933-4134-b4ac-93e8c09d1deb None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.407785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527df50d-0280-4358-8929-b65d3f78c54c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.429780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.430895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.431562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.432195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.433108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:28.433620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.435273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.442750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.443627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.444085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.444361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.451388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.452830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 419/851] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:28.453036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.453768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:28.465181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:28.466093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:28.466998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 433/852] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:28.467488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.563729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd47f-e2d3-4e91-920f-69bcec036798 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.576417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac5b8-0e62-421a-8ac5-d0e71193bc98 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.582989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.602039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.603356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.603737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.604078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.604740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.606189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.609198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.614968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.615619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.615907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.616179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:28.617293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:28.618501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:28.619526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:28.621039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 420/853] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:28.621833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.631925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.633400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:28.644931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:28.645903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 434/854] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:28.646865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.734491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cf978-ac75-4741-ae86-3eda476af17f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.751348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cef08-3502-4681-9ab6-5ab9979e4f3c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.773147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.774122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.775087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.775715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.776843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:28.776843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.778854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.787779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.788504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.788884 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.789257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.790092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:28.790486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.792185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.798013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 421/855] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:28.798013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.806524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 435/856] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:28.806524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.845390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.869397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:28.905475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182f700-18b2-44c5-aa6d-0fbac3f6389d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.918491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bb20-45be-427b-9bb5-88a5772a4726 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:28.941500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.942267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.942562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.942843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.943946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:28.944524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.947091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.955450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:28.956083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:28.956374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:28.956647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:28.957373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=5a06e8f4c38d42fe8e56c86a3834ec11) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:28.957677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:28.959102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:28.975620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 436/857] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/role_assignments?user.id=5a06e8f4c38d42fe8e56c86a3834ec11&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:28.975860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 422/858] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:28.975960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:28.977637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:29.093390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:29.096343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9665-7901-459d-a3df-ada29f7c47b5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:29.112327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53a6d5-abbb-425f-b95c-13cafa75568d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:29.139369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:29.145962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:29.146774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.147062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.147338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.155952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06e32-0394-4e60-8805-b0cb49835e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:29.156564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06e32-0394-4e60-8805-b0cb49835e43 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.156847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06e32-0394-4e60-8805-b0cb49835e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.157120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06e32-0394-4e60-8805-b0cb49835e43 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.157755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06e32-0394-4e60-8805-b0cb49835e43 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:29.158059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06e32-0394-4e60-8805-b0cb49835e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:29.159431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06e32-0394-4e60-8805-b0cb49835e43 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:29.164207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 437/859] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:29.165932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f875-d6cf-4d06-9f76-ed2d0221d2ab None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.166211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f875-d6cf-4d06-9f76-ed2d0221d2ab None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.166480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f875-d6cf-4d06-9f76-ed2d0221d2ab None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.167870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 438/860] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:29.173343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19cebb-5074-4f29-8530-26e69c82ca42 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.173669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19cebb-5074-4f29-8530-26e69c82ca42 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.173895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19cebb-5074-4f29-8530-26e69c82ca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.193285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-eb19cebb-5074-4f29-8530-26e69c82ca42 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:29.194503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-eb19cebb-5074-4f29-8530-26e69c82ca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:29.241966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:29.244394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:29.286180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 439/861] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:29.358030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:29.362113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 423/862] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:26:29.368808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19cebb-5074-4f29-8530-26e69c82ca42 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:29.475408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19cebb-5074-4f29-8530-26e69c82ca42 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:29.490188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:29.511567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:29.512238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.512526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.512809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.523541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:29.525628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:29.540816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:29.541808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:29.542686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:29.542686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:29.542686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:29.542686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 440/863] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:29.552696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:29.567699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:29.679641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6c0e4-4f41-4ec7-9abb-fa331b953003 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:29.684926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb028-f1bd-4ca2-ae71-29c8b6ecfb29 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:29.721918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:29.722533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.722814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.723090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.723430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:29.723771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:29.724076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:29.724180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.724354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.724629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.725215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:29.725457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:29.726567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:29.738756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:29.739768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:29.740675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:29.741407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 424/864] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:29.741486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 441/865] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Sep 5 10:26:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:29.746880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:29.747031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:29.788082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:29.816060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:29.863412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79e326-c653-4d7e-8ae5-e7befebac694 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:29.880642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a5b2-de10-4039-8f71-083ab374c887 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:29.901835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:29.903220 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.903773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.904258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.905597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:29.906180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:29.908321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:29.916484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 425/866] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:29.923759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:29.924892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:29.925593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:29.925935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:29.926274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:29.934800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:29.936758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:29.951491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:29.952596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:29.953684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:29.955635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 442/867] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:29.961148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:30.053140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6438-4811-441f-b5e4-1671163f5d14 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:30.063150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:30.076279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d4a1b-c4e4-48b8-b59e-dcd555b2e21b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:30.081458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:30.100478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:30.102092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:30.103374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:30.104155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:30.105072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:30.105624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:30.107279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:30.119387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 426/868] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:30.136242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa7c8b-cd37-4d80-817c-f83691a6742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:30.137178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7c8b-cd37-4d80-817c-f83691a6742a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:30.137639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7c8b-cd37-4d80-817c-f83691a6742a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:30.138116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7c8b-cd37-4d80-817c-f83691a6742a None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:30.139132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7c8b-cd37-4d80-817c-f83691a6742a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:30.139623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7c8b-cd37-4d80-817c-f83691a6742a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:30.141367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7c8b-cd37-4d80-817c-f83691a6742a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:30.155989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 443/869] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:30.163635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:30.284152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528549ee-11bf-4ce2-be95-3389889daf60 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:30.322730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8d61d-37a6-4c1d-93fd-5d2c0a73e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:30.323332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8d61d-37a6-4c1d-93fd-5d2c0a73e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:30.323633 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8d61d-37a6-4c1d-93fd-5d2c0a73e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:30.323914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8d61d-37a6-4c1d-93fd-5d2c0a73e2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:30.324620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8d61d-37a6-4c1d-93fd-5d2c0a73e2c2 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=e810111bda874bf2aa808991089c2197) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:30.324921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8d61d-37a6-4c1d-93fd-5d2c0a73e2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:30.326340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8d61d-37a6-4c1d-93fd-5d2c0a73e2c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:30.332685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 427/870] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:30 2022] GET /identity/v3/role_assignments?user.id=e810111bda874bf2aa808991089c2197&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:31.068002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f0fe-2ed0-4718-8ea9-322b21633aa8 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:31.068514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f0fe-2ed0-4718-8ea9-322b21633aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:31.068592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f0fe-2ed0-4718-8ea9-322b21633aa8 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:31.070153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 444/871] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:31.075480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794ada-fd12-4367-8618-c85074fa2772 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:31.075798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794ada-fd12-4367-8618-c85074fa2772 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:31.076083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794ada-fd12-4367-8618-c85074fa2772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:31.104763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-89794ada-fd12-4367-8618-c85074fa2772 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:31.106743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-89794ada-fd12-4367-8618-c85074fa2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:31.164219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:31.186618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 428/872] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:31.247424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916d8c-a841-4c04-b77e-415e31da9336 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:31.247767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916d8c-a841-4c04-b77e-415e31da9336 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:31.248004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916d8c-a841-4c04-b77e-415e31da9336 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:31.249476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 445/873] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:31.254872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1122d-7688-40e0-af7b-4f13fd70b614 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:31.255391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1122d-7688-40e0-af7b-4f13fd70b614 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:31.255923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1122d-7688-40e0-af7b-4f13fd70b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:31.277051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4ce1122d-7688-40e0-af7b-4f13fd70b614 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:31.278718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4ce1122d-7688-40e0-af7b-4f13fd70b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:31.349585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 429/874] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:31.479268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916d8c-a841-4c04-b77e-415e31da9336 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:31.585725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916d8c-a841-4c04-b77e-415e31da9336 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:31.621563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:31.622124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:31.622403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:31.622677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:31.631160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1122d-7688-40e0-af7b-4f13fd70b614 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:31.633413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:31.640027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:31.641025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:31.641878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 446/875] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Sep 5 10:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:31.648945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:31.665749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:31.758667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1122d-7688-40e0-af7b-4f13fd70b614 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:31.761084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e9735-dcaf-4553-9c8f-d597453bce46 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:31.773334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:31.803319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:31.804329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:31.804818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:31.805156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:31.806174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:31.806471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:31.806638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:31.806868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:31.807538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:31.807871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:31.808116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:31.809254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:31.809938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:31.818463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 447/876] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Sep 5 10:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:31.825357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:31.833072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 430/877] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:31 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:31.924751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:31.962818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3424b-b337-47bd-93a7-53869a7c6ecb None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:32.010042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04e86d-4598-4c18-aac6-95fbf3d23947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:32.011048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04e86d-4598-4c18-aac6-95fbf3d23947 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.011542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04e86d-4598-4c18-aac6-95fbf3d23947 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.011847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04e86d-4598-4c18-aac6-95fbf3d23947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.023405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04e86d-4598-4c18-aac6-95fbf3d23947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:32.025082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04e86d-4598-4c18-aac6-95fbf3d23947 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-9b04e86d-4598-4c18-aac6-95fbf3d23947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:32.040694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:32.041879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:32.043177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:32.043177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:32.043177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:32.043177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 448/878] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:32.047715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:32.138646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47d4c0-1861-4c45-a3f7-3ac18770e352 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.139139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47d4c0-1861-4c45-a3f7-3ac18770e352 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.139216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47d4c0-1861-4c45-a3f7-3ac18770e352 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.141268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 449/879] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:32.147215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a40c1-4afa-44e4-9198-4891aeb99cc8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.147785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a40c1-4afa-44e4-9198-4891aeb99cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.148020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a40c1-4afa-44e4-9198-4891aeb99cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.164607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83159-aa1f-4126-bf93-76b0f48d86f3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:32.167796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2f8a40c1-4afa-44e4-9198-4891aeb99cc8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:32.169321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2f8a40c1-4afa-44e4-9198-4891aeb99cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:32.203954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:32.204805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.205085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.205361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.206007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:32.206312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:32.207712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:32.224156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 431/880] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:32.231624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:32.252222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 450/881] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:32.265108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:32.338872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f340cf-730a-46cf-ad0d-adae276892f2 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:32.375241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:32.375917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.376203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.376483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.384081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:32.385532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:32.394693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b008f-24f4-43f2-b035-617670dd1255 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.394991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b008f-24f4-43f2-b035-617670dd1255 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.395247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b008f-24f4-43f2-b035-617670dd1255 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.396868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 451/882] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:32.397696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:32.398638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:32.400212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 432/883] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:26:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:32.402813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9c19-711d-47d3-96b1-90cfc0bfc608 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.403092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9c19-711d-47d3-96b1-90cfc0bfc608 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.403366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9c19-711d-47d3-96b1-90cfc0bfc608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.405128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:32.423175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5cdd9c19-711d-47d3-96b1-90cfc0bfc608 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:32.424406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5cdd9c19-711d-47d3-96b1-90cfc0bfc608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:32.476822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:32.506722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 452/884] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:32.508248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:32.512077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8f94-5207-4811-a92b-3569bc8e70bc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:32.539619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd9c19-711d-47d3-96b1-90cfc0bfc608 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:32.549636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:32.550544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.550838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.551120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.551991 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:32.552309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:32.553820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:32.574191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 433/885] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Sep 5 10:26:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:32.579749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:32.643004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd9c19-711d-47d3-96b1-90cfc0bfc608 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:32.678282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:32.678891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.679169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.679441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.680124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:32.682414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:32.691249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd106f-79af-48bd-b420-be29000d24e3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:32.700231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 453/886] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:32 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:26:32.744766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:32.745443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.746033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.746317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.765669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:32.803082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:32.830880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:32.832477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:32.853158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:32.940410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa97b79-d226-4727-b204-695fd8b2fc88 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:32.963142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 434/887] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:32 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:26:32.968304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:32.986424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:32.987366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:32.987746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:32.988030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:32.988818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:32.990648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:33.004072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:33.005129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:33.005968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 454/888] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:33.012247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:33.028003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:33.085170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f812d4-e235-4c98-a6ad-4ea6c5cad4b3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:33.130653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:33.132026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.132728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.133157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.150301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:33.151966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.154141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a5f1-c499-4d89-9ab0-616b41cae591 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:33.158761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:33.172290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:33.173601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:33.174490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:33.174490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:33.174490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:33.178067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 435/889] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:33.178914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:33.206692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:33.208235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.208806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.209266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.210338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:33.211206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:33.213414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.220424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 455/890] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:33.227835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:33.303192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:33.313057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa1f4d-14d8-4cf9-98a7-6e22b7cea8e1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:33.342630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2192ac-d5cf-425f-9fb2-861db8cca717 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:33.348936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:33.349553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.349839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.350120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.350826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:33.351141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:33.353481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.371041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 436/891] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:33.372694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:33.388141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:33.388762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.390527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.390813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.391458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:33.392716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:33.394878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.406806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 456/892] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:33.498700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb5f6-1774-41da-9a6c-f5f3984e11cd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:33.540201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:33.541490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.541971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.542457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.549937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:33.551409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:33.564763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:33.565695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:33.566587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 437/893] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:33.573854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:33.607883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:33.683982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb18ae-4db3-4a34-be77-212e62bec76d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:33.720909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ec41-4a24-4053-a231-1ecd5fdffba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:33.721886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ec41-4a24-4053-a231-1ecd5fdffba3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.722422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ec41-4a24-4053-a231-1ecd5fdffba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.722894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ec41-4a24-4053-a231-1ecd5fdffba3 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.723864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ec41-4a24-4053-a231-1ecd5fdffba3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:33.724366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ec41-4a24-4053-a231-1ecd5fdffba3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:33.725995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ec41-4a24-4053-a231-1ecd5fdffba3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.739842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 457/894] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:33.745394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:33.766929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:33.856702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595268db-6c9b-45b5-a89b-df83e6ee376f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:33.864409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd52dc-443a-4635-ad73-80cd2f6ad8eb None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.864699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd52dc-443a-4635-ad73-80cd2f6ad8eb None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.864985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd52dc-443a-4635-ad73-80cd2f6ad8eb None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.866689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 458/895] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:33.872881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86122-f80e-4fd9-819f-87aec86621ec None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.873170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86122-f80e-4fd9-819f-87aec86621ec None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.873578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86122-f80e-4fd9-819f-87aec86621ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.894178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0dd86122-f80e-4fd9-819f-87aec86621ec None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:33.895370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0dd86122-f80e-4fd9-819f-87aec86621ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:33.898021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:33.898853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:33.899822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:33.900167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:33.900974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] RBAC: Adding query filter params (role.id=181f9c6b82db4e06923f47023777c94f, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=5a06e8f4c38d42fe8e56c86a3834ec11) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:33.901412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:33.902925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:33.909244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 438/896] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:33 2022] GET /identity/v3/role_assignments?user.id=5a06e8f4c38d42fe8e56c86a3834ec11&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=181f9c6b82db4e06923f47023777c94f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:33.981362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 459/897] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:34.254717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:34.344169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:34.366059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2575-229d-4561-a18e-bb8549657a76 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:34.403969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:34.405101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:34.405609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:34.406089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:34.406880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:34.408508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:34.418750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:34.419815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:34.420693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 439/898] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:34.426062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86122-f80e-4fd9-819f-87aec86621ec None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:34.451946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:34.535659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86122-f80e-4fd9-819f-87aec86621ec None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:34.576698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:34.577308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:34.577593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:34.577866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:34.578496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:34.578799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:34.580201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:34.585206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 460/899] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:34.591071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:34.697979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7de1d3-fa7e-489e-b33f-778062c0d4d1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:34.733328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2185-3c4c-4c85-ba64-1119ba011882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:34.733936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2185-3c4c-4c85-ba64-1119ba011882 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:34.734219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2185-3c4c-4c85-ba64-1119ba011882 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:34.734495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2185-3c4c-4c85-ba64-1119ba011882 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:34.735120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2185-3c4c-4c85-ba64-1119ba011882 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:34.735423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2185-3c4c-4c85-ba64-1119ba011882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:34.736823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2185-3c4c-4c85-ba64-1119ba011882 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:34.742045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 440/900] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:34.748181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:34.800113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a777355-bae1-4a81-a2f4-84df15d71af4 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:34.800440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a777355-bae1-4a81-a2f4-84df15d71af4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:34.800669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a777355-bae1-4a81-a2f4-84df15d71af4 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:34.802331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 441/901] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:34.807936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d9a04-5132-4d62-bd38-ead79b51fdf1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:34.808226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d9a04-5132-4d62-bd38-ead79b51fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:34.808509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d9a04-5132-4d62-bd38-ead79b51fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:34.832134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5c1d9a04-5132-4d62-bd38-ead79b51fdf1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:34.833888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c1d9a04-5132-4d62-bd38-ead79b51fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:34.838358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:34.849400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:34.868597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751647-05d8-4404-bd6d-ddc991cc2b37 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:34.907240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:34.907943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:34.908212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:34.908489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:34.909283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] RBAC: Adding query filter params (interface=public, service_id=ef13350f26564118b1f772f50856f266, region_id=RegionOne) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:34.909595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:34.910991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:34.916054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 442/902] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:34.919263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 461/903] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:26:34 2022] GET /identity/v3/endpoints?service_id=ef13350f26564118b1f772f50856f266&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:34.924584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d9a04-5132-4d62-bd38-ead79b51fdf1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:35.036219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d9a04-5132-4d62-bd38-ead79b51fdf1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:35.073492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:35.074280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.074563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.074834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.076772 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:35.078219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:35.089758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 443/904] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:34 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:26:35.208608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:35.318127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3219-feed-42b7-b19d-a22b61aacf79 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:35.354547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b393e-d781-4d08-b1fd-f8a3a6618071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:35.355184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b393e-d781-4d08-b1fd-f8a3a6618071 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.355465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b393e-d781-4d08-b1fd-f8a3a6618071 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.355780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b393e-d781-4d08-b1fd-f8a3a6618071 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.356370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b393e-d781-4d08-b1fd-f8a3a6618071 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:35.357747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b393e-d781-4d08-b1fd-f8a3a6618071 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ad7b393e-d781-4d08-b1fd-f8a3a6618071 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:35.366852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:35.369243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:35.371690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:35.373471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 462/905] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Sep 5 10:26:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:35.374865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:35.383123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:35.429194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f4ba1-e669-4673-a6c9-44f0796d0d8a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.430365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f4ba1-e669-4673-a6c9-44f0796d0d8a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.431113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f4ba1-e669-4673-a6c9-44f0796d0d8a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.433150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 463/906] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:35.438231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d3f4b-0e78-4655-ad36-bae2bddad905 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.438520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d3f4b-0e78-4655-ad36-bae2bddad905 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.438797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d3f4b-0e78-4655-ad36-bae2bddad905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.460643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-582d3f4b-0e78-4655-ad36-bae2bddad905 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:35.462953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-582d3f4b-0e78-4655-ad36-bae2bddad905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:35.476232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:35.498544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc939-632f-4c98-8a3d-087393359793 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:35.540147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:35.540761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.541044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.541319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.541959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:35.542373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:35.544023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:35.553882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 444/907] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:35.554894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:35.555792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 464/908] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:35.625692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:35.661951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba460-2d1b-46ad-ac65-361db2f3d112 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:35.698222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:35.698833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.699116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.699394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.700056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:35.700418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:35.701790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:35.707299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 445/909] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:35.713468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d3f4b-0e78-4655-ad36-bae2bddad905 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:35.819907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d3f4b-0e78-4655-ad36-bae2bddad905 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:35.823679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:35.864780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57d59c-c7a0-42b9-8161-b08ac391d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:35.865391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57d59c-c7a0-42b9-8161-b08ac391d331 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.865674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57d59c-c7a0-42b9-8161-b08ac391d331 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.865963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57d59c-c7a0-42b9-8161-b08ac391d331 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.866660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57d59c-c7a0-42b9-8161-b08ac391d331 None admin] RBAC: Adding query filter params (interface=public, service_id=dc999746e997428cb8d1a2435318a6f5, region_id=RegionOne) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:35.866975 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57d59c-c7a0-42b9-8161-b08ac391d331 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:35.868426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57d59c-c7a0-42b9-8161-b08ac391d331 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:35.874231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 465/910] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:26:35 2022] GET /identity/v3/endpoints?service_id=dc999746e997428cb8d1a2435318a6f5&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:35.875817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283825-18d5-43e4-8112-bae2a52a2622 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.875817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283825-18d5-43e4-8112-bae2a52a2622 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.875997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad283825-18d5-43e4-8112-bae2a52a2622 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.877444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 466/911] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:35.880048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283825-18d5-43e4-8112-bae2a52a2622 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:35.892200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:35.934047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdbdc8-4a35-4cea-b8f3-8c761c3c286c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:35.965699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:35.971402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116787e5-3626-40c3-a756-b2305bd34736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:35.972038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116787e5-3626-40c3-a756-b2305bd34736 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.972320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116787e5-3626-40c3-a756-b2305bd34736 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.972594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116787e5-3626-40c3-a756-b2305bd34736 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:35.973361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116787e5-3626-40c3-a756-b2305bd34736 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:35.974848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116787e5-3626-40c3-a756-b2305bd34736 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:35.990474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 446/912] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:35 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:26:35.990625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad283825-18d5-43e4-8112-bae2a52a2622 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:35.992089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ff76-a334-4804-8bc0-6d2c3172dd85 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:35.992442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ff76-a334-4804-8bc0-6d2c3172dd85 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:35.992829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ff76-a334-4804-8bc0-6d2c3172dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:36.012960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8595ff76-a334-4804-8bc0-6d2c3172dd85 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:36.014936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8595ff76-a334-4804-8bc0-6d2c3172dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:36.047493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:36.048149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:36.048434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:36.048711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:36.049338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:36.050761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:36.068143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 467/913] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:35 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:26:36.110540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 447/914] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:36.388949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:36.462287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:36.501925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3521e6-9954-433f-8f40-81f6e197b4d1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:36.537960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:36.538599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:36.538881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:36.539161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:36.549892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:36.555176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:36.556826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:36.557686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 468/915] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Sep 5 10:26:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:36.564788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ff76-a334-4804-8bc0-6d2c3172dd85 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:36.673354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ff76-a334-4804-8bc0-6d2c3172dd85 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:36.697910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:36.711435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:36.712926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:36.713416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:36.713980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:36.714883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:36.715396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:36.717019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:36.726515 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 448/916] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Sep 5 10:26:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:36.732885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:36.841148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53a0e1-5181-4ac2-b24f-963bf2e5e1dc None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:36.869895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:36.878045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:36.878687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:36.878972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:36.879251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:36.890703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:36.892253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:36.907776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:36.909080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:36.910007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:36.910007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:36.910007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:36.910007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 469/917] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:36.915683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.021430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115aa06-0faa-48c0-9062-139fdadb4023 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.057527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d18e0-3635-4857-8ed2-371c42f39ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.058158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d18e0-3635-4857-8ed2-371c42f39ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.058445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d18e0-3635-4857-8ed2-371c42f39ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.058786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d18e0-3635-4857-8ed2-371c42f39ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.059447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d18e0-3635-4857-8ed2-371c42f39ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:37.059807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d18e0-3635-4857-8ed2-371c42f39ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:37.061233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d18e0-3635-4857-8ed2-371c42f39ad5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:37.076083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 449/918] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:37.081616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.202220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d49160-c805-49f4-81e2-52dd74f4fb08 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.237118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671686-d674-4f8c-ae2d-42aabbc36311 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.237459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671686-d674-4f8c-ae2d-42aabbc36311 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.237676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671686-d674-4f8c-ae2d-42aabbc36311 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.239722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 450/919] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:37.240175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.240845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.241129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.241402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.247076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf3d19-2f30-43dd-a6c3-810ea46030bf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.247361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf3d19-2f30-43dd-a6c3-810ea46030bf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.247664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf3d19-2f30-43dd-a6c3-810ea46030bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.252644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:37.254537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:37.266721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fdaf3d19-2f30-43dd-a6c3-810ea46030bf None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:37.267939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fdaf3d19-2f30-43dd-a6c3-810ea46030bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:37.269338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:37.270283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:37.271236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:37.273018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 470/920] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:26:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:37.280484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.323933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:37.333552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:37.362851 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 451/921] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:37.403106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63ca45-f721-4099-b734-80f255741529 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.439856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.440813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.441307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.441889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.442880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:37.443439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:37.449684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:37.464025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 471/922] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Sep 5 10:26:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:37.470154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf3d19-2f30-43dd-a6c3-810ea46030bf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.575616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf3d19-2f30-43dd-a6c3-810ea46030bf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.612150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.613157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.613647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.614182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.625729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:37.627634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:37.643733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:37.644742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:37.645630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:37.645630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:37.645630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:37.647781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 452/923] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:37.654548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.655535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.687104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:37.769362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c3df9-f1e0-475f-862a-05d46e4c4093 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.778933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:37.783433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48eb43-14ca-47f1-b15a-f6d4941a8156 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.810850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.811874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.812361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.812856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.813724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:37.814281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:37.815880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:37.822153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.822848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.823134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.823411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.824045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:37.825428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:37.831465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 453/924] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:37.835187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:37.836207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:37.837116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 472/925] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:37.842599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.843461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:37.939811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:37.953796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db475-9f30-4f1f-9a18-3043fe62e54e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.958417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d323e5-8365-43f6-9936-d75b5ba364ec None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:37.990691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.991182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.991468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:37.991778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:37.992415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:37.992819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:37.994675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:37.998108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d73ac-8684-4b07-b336-8a64ffe85d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:37.998989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d73ac-8684-4b07-b336-8a64ffe85d5b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:37.999497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d73ac-8684-4b07-b336-8a64ffe85d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.000023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d73ac-8684-4b07-b336-8a64ffe85d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.003625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 473/926] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:38.005676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.012543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d73ac-8684-4b07-b336-8a64ffe85d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.014000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d73ac-8684-4b07-b336-8a64ffe85d5b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-799d73ac-8684-4b07-b336-8a64ffe85d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:38.025534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:38.026537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:38.027531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 454/927] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:38.028625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9af15-4da2-4b87-82a5-cea3c8c5b942 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.028625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9af15-4da2-4b87-82a5-cea3c8c5b942 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.028625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9af15-4da2-4b87-82a5-cea3c8c5b942 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.029758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 455/928] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:38.032842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9af15-4da2-4b87-82a5-cea3c8c5b942 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.042571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:38.121161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd48ce-bbdb-47d1-b136-6664d7358ac1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:38.146159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9af15-4da2-4b87-82a5-cea3c8c5b942 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:38.156680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35b6be-add8-40a9-abed-32609f80a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:38.157293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35b6be-add8-40a9-abed-32609f80a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.157574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35b6be-add8-40a9-abed-32609f80a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.157855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35b6be-add8-40a9-abed-32609f80a5ed None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.158490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35b6be-add8-40a9-abed-32609f80a5ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:38.158794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35b6be-add8-40a9-abed-32609f80a5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.160200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35b6be-add8-40a9-abed-32609f80a5ed None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.165667 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 474/929] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Sep 5 10:26:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:38.166815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0c51-ecd9-4854-818f-993fa381c5f6 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.167085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0c51-ecd9-4854-818f-993fa381c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.167359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b0c51-ecd9-4854-818f-993fa381c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.184613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-653b0c51-ecd9-4854-818f-993fa381c5f6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:38.185104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a87594-b565-4d57-b0ef-1ca3c9069104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:38.185714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87594-b565-4d57-b0ef-1ca3c9069104 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.185812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-653b0c51-ecd9-4854-818f-993fa381c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:38.186003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87594-b565-4d57-b0ef-1ca3c9069104 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.186283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87594-b565-4d57-b0ef-1ca3c9069104 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.186981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a87594-b565-4d57-b0ef-1ca3c9069104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:38.187294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a87594-b565-4d57-b0ef-1ca3c9069104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.188774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a87594-b565-4d57-b0ef-1ca3c9069104 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.200810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 456/930] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:38.202093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc5ec7-f350-46c2-b751-6de1fbcb0580 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.202379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc5ec7-f350-46c2-b751-6de1fbcb0580 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.202662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc5ec7-f350-46c2-b751-6de1fbcb0580 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.203910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 457/931] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:38.204593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc5ec7-f350-46c2-b751-6de1fbcb0580 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.214742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:38.260240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 475/932] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:38.261051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b0c51-ecd9-4854-818f-993fa381c5f6 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.288027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:38.310367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc5ec7-f350-46c2-b751-6de1fbcb0580 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:38.345919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae0d18-5a93-4049-aa2d-2b68670aee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:38.346527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0d18-5a93-4049-aa2d-2b68670aee33 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.346817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0d18-5a93-4049-aa2d-2b68670aee33 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.347091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0d18-5a93-4049-aa2d-2b68670aee33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.347787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae0d18-5a93-4049-aa2d-2b68670aee33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.349190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae0d18-5a93-4049-aa2d-2b68670aee33 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.378895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 458/933] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:38.378895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc8b-cdd8-466c-a9d7-5b2af8a2a0e8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.378895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc8b-cdd8-466c-a9d7-5b2af8a2a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.378895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5cc8b-cdd8-466c-a9d7-5b2af8a2a0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.387903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b0c51-ecd9-4854-818f-993fa381c5f6 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:38.395662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8fb5cc8b-cdd8-466c-a9d7-5b2af8a2a0e8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:38.398055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8fb5cc8b-cdd8-466c-a9d7-5b2af8a2a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:38.436118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:38.437056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.437410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.437783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/5a06e8f4c38d42fe8e56c86a3834ec11/roles/181f9c6b82db4e06923f47023777c94f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.440393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=5a06e8f4c38d42fe8e56c86a3834ec11, role_id=181f9c6b82db4e06923f47023777c94f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.441988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.463931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 476/934] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:26:38 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/5a06e8f4c38d42fe8e56c86a3834ec11/roles/181f9c6b82db4e06923f47023777c94f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:26:38.478347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:38.493567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 459/935] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:38.533532 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.623841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:38.651732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d294d6-d8a2-4dff-b083-5745b575c92d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:38.687676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:38.688313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.688595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.688868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.689454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.690829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:38.700976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:38.702055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:38.702956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 477/936] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:38.710375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5cc8b-cdd8-466c-a9d7-5b2af8a2a0e8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.780021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.822133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5cc8b-cdd8-466c-a9d7-5b2af8a2a0e8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:38.858789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:38.859411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.859726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.860006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.860694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:38.861002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.862435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.867508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 460/937] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:38.873822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.908355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f223c6b-b6cc-47bb-a2bf-8800d4aaee3c None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:38.942002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:38.948738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:38.949784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:38.951856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:38.952467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:38.953408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:38.955021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:38.965939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:38.966936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 10:26:38.967873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:38.970874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 478/938] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Sep 5 10:26:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:38.979623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:38.982559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:38.994007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f75a-a99a-47c6-8671-aaf91f480a7f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:39.038680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:39.040854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:39.041616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:39.042075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:39.043143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:39.043950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:39.045345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:39.053588 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 461/939] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:39.063637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:39.108053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5137d-6039-4ee9-ab29-86df69179bf5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:39.144291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:39.144887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:39.145170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:39.145443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:39.146085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:39.146390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:39.147796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:39.158564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 479/940] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:39.159657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:39.183608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39d097-702d-4321-9569-ef6aa841296f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:39.205961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:39.223556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:39.224358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:39.224646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:39.224928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:39.225771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] RBAC: Adding query filter params (interface=public, service_id=353797bc756a4b6793131f43a9d5b20d, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:39.226090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:39.228114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:39.238513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:39.239706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 462/941] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:26:39 2022] GET /identity/v3/endpoints?service_id=353797bc756a4b6793131f43a9d5b20d&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:39.240731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:39.269547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5e70-1e3b-46c7-ba76-99c3c234ca77 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:39.306527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:39.307130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:39.307411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:39.307708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:39.308876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:39.309396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:39.311495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:39.319661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 480/942] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:39.323802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:39.363906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88b586-cb62-4655-8cbb-2b54aeb892ae None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:39.406630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9469bee-52c7-4d02-8751-0abba69deea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:39.407248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9469bee-52c7-4d02-8751-0abba69deea6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:39.407533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9469bee-52c7-4d02-8751-0abba69deea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:39.407834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9469bee-52c7-4d02-8751-0abba69deea6 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:39.408919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9469bee-52c7-4d02-8751-0abba69deea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:39.410241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9469bee-52c7-4d02-8751-0abba69deea6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:39.423658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 463/943] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:39 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:26:39.438360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261937c2-f1d9-4e2f-908f-6c8d84059ed7 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:39.475978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:39.479105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1c305-6647-44e8-a8e1-13bb31ad4b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:39.479768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c305-6647-44e8-a8e1-13bb31ad4b71 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:39.480070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c305-6647-44e8-a8e1-13bb31ad4b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:39.480418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c305-6647-44e8-a8e1-13bb31ad4b71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:39.481113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1c305-6647-44e8-a8e1-13bb31ad4b71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:39.482525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1c305-6647-44e8-a8e1-13bb31ad4b71 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:39.514080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 481/944] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:40.502435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c92812-39e1-4ccc-b8b5-3afa4ceeddd2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:40.503118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c92812-39e1-4ccc-b8b5-3afa4ceeddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:40.503118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c92812-39e1-4ccc-b8b5-3afa4ceeddd2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:40.503309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1e734-7339-4959-acdd-e9e9702ed7ff None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:40.503309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1e734-7339-4959-acdd-e9e9702ed7ff None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:40.504405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1e734-7339-4959-acdd-e9e9702ed7ff None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:40.504629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 464/945] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:40.505274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 482/946] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:40.511165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0caa-bfc4-481c-a2f8-53ecc1965c1c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:40.511457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0caa-bfc4-481c-a2f8-53ecc1965c1c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:40.511767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0caa-bfc4-481c-a2f8-53ecc1965c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:40.515684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc5db-0ff3-41fb-a405-ad978cf8c033 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:40.515987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc5db-0ff3-41fb-a405-ad978cf8c033 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:40.516237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc5db-0ff3-41fb-a405-ad978cf8c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:40.533511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f95f0caa-bfc4-481c-a2f8-53ecc1965c1c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:40.534877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-75ebc5db-0ff3-41fb-a405-ad978cf8c033 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:40.535435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f95f0caa-bfc4-481c-a2f8-53ecc1965c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:40.536096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-75ebc5db-0ff3-41fb-a405-ad978cf8c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:40.592791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:40.626320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 483/948] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:40.631814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 465/948] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:40.903033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebc5db-0ff3-41fb-a405-ad978cf8c033 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:40.911628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0caa-bfc4-481c-a2f8-53ecc1965c1c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.022179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebc5db-0ff3-41fb-a405-ad978cf8c033 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.032755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0caa-bfc4-481c-a2f8-53ecc1965c1c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.037347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:41.061367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.062011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.062289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.062561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.073967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:41.077159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.078000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.078500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:41.078980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:41.080146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:41.080995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 484/949] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Sep 5 10:26:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:41.082007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.082833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:41.087915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:41.087915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING keystone.server.flask.common [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 10:26:41.095628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.108124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 10:26:41.108124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 10:26:41.108124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [parameters: {'id': '2d0fc28d412e4796966ff8a8944c6a88', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 10:26:41.108124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d0fc28d412e4796966ff8a8944c6a88.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d0fc28d412e4796966ff8a8944c6a88. Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:26:41.127423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 05 10:26:41.128274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 05 10:26:41.129234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 10:26:41.130134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 10:26:41.131024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:26:41.133045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'id': '2d0fc28d412e4796966ff8a8944c6a88', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.135640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:41.137508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2d0fc28d412e4796966ff8a8944c6a88. Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 466/950] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Sep 5 10:26:40 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:41.140427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.181963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:41.234798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0adb3-5c63-44a0-99cf-79f54c059f9e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.265750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271aafe-f72a-435d-bf83-c54d9a91c04c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.274734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.275903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.276405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.276989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.277903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:41.278533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:41.280141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:41.290358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 485/951] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:41.298164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.303383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.304136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.304348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.304624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.312098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:41.313809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:41.327064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:41.328061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:41.328957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:41.333268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 467/952] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:41.334261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.334387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:41.409263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8a90-fec8-4aa7-a08b-8de877902342 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.429884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:41.441510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b8f9-6437-4f76-b782-02856abf09dd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.446977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8bbe1-e67e-4514-a904-409484498f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.447891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8bbe1-e67e-4514-a904-409484498f9c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.448354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8bbe1-e67e-4514-a904-409484498f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.448831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8bbe1-e67e-4514-a904-409484498f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.460118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8bbe1-e67e-4514-a904-409484498f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:41.462257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8bbe1-e67e-4514-a904-409484498f9c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:41.477698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a0c6e-2fb6-4b53-b0ce-42ab8fe4e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-44f8bbe1-e67e-4514-a904-409484498f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:41.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:41.478847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:41.479888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:41.479888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:41.479888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:41.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a0c6e-2fb6-4b53-b0ce-42ab8fe4e163 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a0c6e-2fb6-4b53-b0ce-42ab8fe4e163 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a0c6e-2fb6-4b53-b0ce-42ab8fe4e163 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a0c6e-2fb6-4b53-b0ce-42ab8fe4e163 None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:41.480072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a0c6e-2fb6-4b53-b0ce-42ab8fe4e163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:41.481256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a0c6e-2fb6-4b53-b0ce-42ab8fe4e163 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:41.483851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 486/953] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:41.485114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99268-d0e7-40dd-bd08-da36a55fc57f None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.485399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99268-d0e7-40dd-bd08-da36a55fc57f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.485672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99268-d0e7-40dd-bd08-da36a55fc57f None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.487730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 487/954] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:41.488935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b99268-d0e7-40dd-bd08-da36a55fc57f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.507791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 468/955] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:41.511452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc178e-09c9-421d-afd4-89e659f005d7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.512169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc178e-09c9-421d-afd4-89e659f005d7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.514228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc178e-09c9-421d-afd4-89e659f005d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.541157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e4bc178e-09c9-421d-afd4-89e659f005d7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:41.542780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4bc178e-09c9-421d-afd4-89e659f005d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:41.600521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:41.616173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b99268-d0e7-40dd-bd08-da36a55fc57f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.627634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 469/956] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:41.627634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec628-00a9-4f55-94d9-0aecff8fc58c None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.627634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec628-00a9-4f55-94d9-0aecff8fc58c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.627634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec628-00a9-4f55-94d9-0aecff8fc58c None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.628341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 470/957] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:41.631106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982f34b-0a33-47f3-acef-26aec7ce1a9b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.631106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982f34b-0a33-47f3-acef-26aec7ce1a9b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.631106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982f34b-0a33-47f3-acef-26aec7ce1a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.654933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e982f34b-0a33-47f3-acef-26aec7ce1a9b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:41.656169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e982f34b-0a33-47f3-acef-26aec7ce1a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:41.672314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.673047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.673314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.673585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.674239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:41.674542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:41.676655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:41.690507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 488/958] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:41.696743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.739293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 471/959] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:41.814415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c15d8-d2b8-4677-a3d4-3aef849035ca None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:41.851178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:41.851880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:41.852732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:41.853013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:41.860628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:41.862126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:41.874770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:41.875882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:41.876859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 489/960] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:41.882061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982f34b-0a33-47f3-acef-26aec7ce1a9b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.894772 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:41.900094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:41.911877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.012910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f1ed-9e24-497b-9e09-2943079b8707 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.013155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982f34b-0a33-47f3-acef-26aec7ce1a9b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.051897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.052976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.053421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.053859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.054687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.054828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.055881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.056165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.056438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.057173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:42.057482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.057758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.058902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:42.070127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:42.072074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:42.072969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:42.073820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 490/961] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:42.074368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.089671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 472/962] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Sep 5 10:26:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:42.089671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.154400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.159286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.190626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750d46-b036-4ac5-9606-eb614a31673e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.199546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc2e14-bde9-48ce-94bb-6c2da65fe4b6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.226432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.227735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.228020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.228294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.228878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.230260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.236033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.236724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.237069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.237453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.238142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:42.238510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:42.238955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:42.240064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:42.241535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 491/963] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:42.242352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.245849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.255636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 473/964] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:42.255636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.349488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c8e66-8901-4f72-8f0a-762f670979ea None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.364648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ff6a-df6a-45c7-b132-39c4af3e3a95 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.384197 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.384796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.385068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.385338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.389853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.396137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.402674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.403464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.403832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.404116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.404756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:42.405124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.406511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.411450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 474/965] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:42.412082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.463842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.465323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.521164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a621-dc0f-4729-b244-947373623cd3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.557945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.558878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.559310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.559785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.560688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:42.561252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.562779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.567232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 492/966] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:26:42.568091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.568636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 475/967] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:42.573363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.611978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.637817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.681254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5edce3-591f-4df3-8516-3cd1f8d74281 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.684582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58502a07-a340-4baa-960d-21b01f069ac5 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.717165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.717825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.718115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.718395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.721035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.721681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.721966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.722247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.722910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:42.723219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.724686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.730331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 493/968] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:42.730973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.732461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.734193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:42.752718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:42.753776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:42.754684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:42.754684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:42.754684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:42.757031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 476/969] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:42.762321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:42.862314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.867723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abbdfa-3851-4dbd-aafa-a624a413891f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.907849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be056e-a1e2-4c3d-aae7-41bb9ac8ff2c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:42.916235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.916859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.917140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.917417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.918568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.920590 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.929023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:42.947684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 494/970] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:42.968018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:42.968710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:42.969006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:42.969283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:42.969957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:42.970336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:42.971812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:42.986723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 477/971] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:42.992420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:43.113534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a822cd5-e349-448e-ae22-b004911d4acd None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:43.150645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:43.151281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:43.151563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:43.151861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:43.159239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:43.160731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:43.173471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:43.174516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:43.175438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 495/972] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:43.181069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:43.294471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41d11-b34d-4985-af7c-d9987df44538 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:43.331635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224cf3-818b-4f94-8a1f-ab6321816fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:43.332258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224cf3-818b-4f94-8a1f-ab6321816fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:43.332580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224cf3-818b-4f94-8a1f-ab6321816fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:43.332859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224cf3-818b-4f94-8a1f-ab6321816fe6 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:43.333553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224cf3-818b-4f94-8a1f-ab6321816fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:43.333863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224cf3-818b-4f94-8a1f-ab6321816fe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:43.335299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224cf3-818b-4f94-8a1f-ab6321816fe6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:43.348286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 478/973] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:43.354462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:43.374154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:43.469382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd8789-31f6-488e-8168-699e5e5a817f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:43.505425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338201-f5c6-4658-a164-5b703bff6650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:43.506092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338201-f5c6-4658-a164-5b703bff6650 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:43.506376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338201-f5c6-4658-a164-5b703bff6650 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:43.506653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338201-f5c6-4658-a164-5b703bff6650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:43.507440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338201-f5c6-4658-a164-5b703bff6650 None admin] RBAC: Adding query filter params (role.id=181f9c6b82db4e06923f47023777c94f, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=5a06e8f4c38d42fe8e56c86a3834ec11) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:43.507779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338201-f5c6-4658-a164-5b703bff6650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:43.510176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338201-f5c6-4658-a164-5b703bff6650 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:43.516598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 496/974] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:43 2022] GET /identity/v3/role_assignments?user.id=5a06e8f4c38d42fe8e56c86a3834ec11&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=181f9c6b82db4e06923f47023777c94f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:43.624351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2065d-ac7f-4fb7-8bc8-3f0784650338 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:43.624876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2065d-ac7f-4fb7-8bc8-3f0784650338 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:43.625062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2065d-ac7f-4fb7-8bc8-3f0784650338 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:43.626853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 479/975] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:43.632473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a09af-4384-4501-bfb2-4d38cb4957b9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:43.632972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a09af-4384-4501-bfb2-4d38cb4957b9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:43.633107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a09af-4384-4501-bfb2-4d38cb4957b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:43.653346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ec6a09af-4384-4501-bfb2-4d38cb4957b9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:43.654697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ec6a09af-4384-4501-bfb2-4d38cb4957b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:43.727876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 497/976] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:44.004279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2065d-ac7f-4fb7-8bc8-3f0784650338 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:44.035028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:44.115842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2065d-ac7f-4fb7-8bc8-3f0784650338 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:44.152754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:44.153364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:44.153645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:44.153918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:44.154576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:44.156031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:44.171356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.sql.core [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 10:26:44.171356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 10:26:44.171356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [parameters: {'user_id': '4862853d8ed24713bcec1e951c1ee202', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 10:26:44.171356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 05 10:26:44.178230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:26:44.179111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application yield resource Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application next(self.gen) Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise self.value Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application session.commit() Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 10:26:44.180702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.session.flush() Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application compat.raise_( Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 10:26:44.182142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 10:26:44.183057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application conn.query(q) Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application result.read() Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 10:26:44.183969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [parameters: {'user_id': '4862853d8ed24713bcec1e951c1ee202', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:44.184835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 05 10:26:44.187418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 05 10:26:44.196927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 05 10:26:44.196927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 05 10:26:44.196927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 10:26:44.196927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 10:26:44.196927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 10:26:44.196927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:44.196927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 480/977] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Sep 5 10:26:44 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:44.197478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a09af-4384-4501-bfb2-4d38cb4957b9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:44.202001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:44.297710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a09af-4384-4501-bfb2-4d38cb4957b9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:44.335619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da961eac-16e8-4d0a-8dd9-e25879df5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:44.336723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da961eac-16e8-4d0a-8dd9-e25879df5693 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:44.337311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da961eac-16e8-4d0a-8dd9-e25879df5693 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:44.337735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da961eac-16e8-4d0a-8dd9-e25879df5693 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:44.345174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da961eac-16e8-4d0a-8dd9-e25879df5693 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:44.346949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da961eac-16e8-4d0a-8dd9-e25879df5693 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-da961eac-16e8-4d0a-8dd9-e25879df5693 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:44.359554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:44.360763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 10:26:44.361933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:44.364109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 498/978] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:44.371557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:44.469714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:44.480475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96936959-95ac-4f16-bbf6-228c9a96c416 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:44.518793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f08ddf-1e3f-4454-8c0e-4c74c976f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:44.519401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f08ddf-1e3f-4454-8c0e-4c74c976f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:44.519762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f08ddf-1e3f-4454-8c0e-4c74c976f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:44.520037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f08ddf-1e3f-4454-8c0e-4c74c976f9b3 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:44.520739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f08ddf-1e3f-4454-8c0e-4c74c976f9b3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:44.521043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f08ddf-1e3f-4454-8c0e-4c74c976f9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:44.522681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f08ddf-1e3f-4454-8c0e-4c74c976f9b3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:44.562270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 481/979] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Sep 5 10:26:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:44.754227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca87441-7eeb-4659-a6c8-8e0a46100ba8 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:44.754751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca87441-7eeb-4659-a6c8-8e0a46100ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:44.754751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca87441-7eeb-4659-a6c8-8e0a46100ba8 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:44.756448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 499/980] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:44.762056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11a27-cc49-44b2-ab7b-3e9946c52cf3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:44.762476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11a27-cc49-44b2-ab7b-3e9946c52cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:44.762684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11a27-cc49-44b2-ab7b-3e9946c52cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:44.783496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-66d11a27-cc49-44b2-ab7b-3e9946c52cf3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:44.785035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-66d11a27-cc49-44b2-ab7b-3e9946c52cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:44.857843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 482/981] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:44.960406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca98e0-8a2c-45ca-8a5d-1ebac61be6e4 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:44.960752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca98e0-8a2c-45ca-8a5d-1ebac61be6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:44.960978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca98e0-8a2c-45ca-8a5d-1ebac61be6e4 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:44.963182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 500/982] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:44.968200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c95a2-745f-43a5-9d39-6d494f8498e7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:44.968496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c95a2-745f-43a5-9d39-6d494f8498e7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:44.968778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c95a2-745f-43a5-9d39-6d494f8498e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:44.987563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d15c95a2-745f-43a5-9d39-6d494f8498e7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:44.988849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d15c95a2-745f-43a5-9d39-6d494f8498e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:45.057599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 483/983] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:45.130533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca98e0-8a2c-45ca-8a5d-1ebac61be6e4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:45.201839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:45.236543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca98e0-8a2c-45ca-8a5d-1ebac61be6e4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:45.271057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:45.271688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:45.271972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:45.272248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:45.272900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:45.274547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:45.290992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 501/984] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:45 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:45.326830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c95a2-745f-43a5-9d39-6d494f8498e7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:45.337869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:45.439178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c95a2-745f-43a5-9d39-6d494f8498e7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:45.482550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094712c-6dc5-4924-b522-f2d4df1075ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:45.483191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094712c-6dc5-4924-b522-f2d4df1075ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:45.483472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094712c-6dc5-4924-b522-f2d4df1075ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:45.483792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094712c-6dc5-4924-b522-f2d4df1075ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:45.484377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094712c-6dc5-4924-b522-f2d4df1075ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:45.485751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094712c-6dc5-4924-b522-f2d4df1075ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c094712c-6dc5-4924-b522-f2d4df1075ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:45.495167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:45.496621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:45.497474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 484/985] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:45.504897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:45.580777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d017d70-aeb7-4e22-8c5d-5203233f55ba None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:45.581058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d017d70-aeb7-4e22-8c5d-5203233f55ba None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:45.581344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d017d70-aeb7-4e22-8c5d-5203233f55ba None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:45.582853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 485/986] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:45.588260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf67-6431-424b-88d5-93384e3088ad None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:45.588551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf67-6431-424b-88d5-93384e3088ad None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:45.588828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf67-6431-424b-88d5-93384e3088ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:45.608906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-06fbcf67-6431-424b-88d5-93384e3088ad None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:45.610100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-06fbcf67-6431-424b-88d5-93384e3088ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:45.615916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644cf7-57e6-44ee-9715-5f24ff17ab4e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:45.646907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:45.655030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:45.656566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:45.657088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:45.657911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:45.659010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:45.659407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:45.660842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:45.666740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 502/987] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:45.672156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:45.679543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:45.686485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 486/988] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:45.777655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94690181-1e24-4091-969d-a5dcdd2fcafe None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:45.811833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:45.812458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:45.812723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:45.812996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:45.813626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:45.813928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:45.815294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:45.820377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 503/989] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:45.826265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbcf67-6431-424b-88d5-93384e3088ad None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:45.931873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbcf67-6431-424b-88d5-93384e3088ad None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:45.954806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:45.968053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:45.968985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:45.969448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:45.969871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:45.972902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] RBAC: Adding query filter params (interface=admin, service_id=353797bc756a4b6793131f43a9d5b20d, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:45.973384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:45.974938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:45.981183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 487/990] 10.222.0.16 () {56 vars in 1249 bytes} [Mon Sep 5 10:26:45 2022] GET /identity/v3/endpoints?service_id=353797bc756a4b6793131f43a9d5b20d&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:45.986599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:46.020826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:46.050550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:46.068185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda5c83-020f-4813-9dc8-8662328b6233 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:46.095579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad11256-531b-4ee8-a30c-ee72e8f50c62 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:46.106113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:46.106741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:46.107022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:46.107291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] PATH_INFO: `/v3/services/image` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:46.107910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:46.109781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:46.118845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:46.119882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:46.126198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 504/991] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Sep 5 10:26:45 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:46.128716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:46.138652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:46.139270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:46.139548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:46.139868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:46.140473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:46.141835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:46.148582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 488/992] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:45 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:26:46.247989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1b482-6dab-4165-bfe9-a69cbdca9589 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:46.274291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:46.289718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e879b-4b80-40fe-adae-17c0fdf6abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:46.290617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e879b-4b80-40fe-adae-17c0fdf6abb2 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:46.290893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e879b-4b80-40fe-adae-17c0fdf6abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:46.291169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e879b-4b80-40fe-adae-17c0fdf6abb2 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:46.291846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e879b-4b80-40fe-adae-17c0fdf6abb2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:46.292151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e879b-4b80-40fe-adae-17c0fdf6abb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:46.293540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e879b-4b80-40fe-adae-17c0fdf6abb2 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:46.299356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 505/993] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:46.305671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:46.412183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce637-fbab-48bf-80b3-f1a75a26f84d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:46.438469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:46.449374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479308c1-dc47-47db-a484-accae3771b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:46.449982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479308c1-dc47-47db-a484-accae3771b68 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:46.450262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479308c1-dc47-47db-a484-accae3771b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:46.450560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479308c1-dc47-47db-a484-accae3771b68 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:46.451264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479308c1-dc47-47db-a484-accae3771b68 None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:46.451571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479308c1-dc47-47db-a484-accae3771b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:46.453020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479308c1-dc47-47db-a484-accae3771b68 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:46.457768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 489/994] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:47.230453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1787-ca24-4c6f-a489-3d4adcf12f26 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:47.230993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1787-ca24-4c6f-a489-3d4adcf12f26 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:47.230993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1787-ca24-4c6f-a489-3d4adcf12f26 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:47.232416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 506/995] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:47.237476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac4de-68a1-4cb9-9b47-e3b67bca9587 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:47.237855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac4de-68a1-4cb9-9b47-e3b67bca9587 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:47.238047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac4de-68a1-4cb9-9b47-e3b67bca9587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:47.257554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-439ac4de-68a1-4cb9-9b47-e3b67bca9587 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:47.258983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-439ac4de-68a1-4cb9-9b47-e3b67bca9587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:47.329298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 490/996] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:47.598992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1787-ca24-4c6f-a489-3d4adcf12f26 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:47.700791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1787-ca24-4c6f-a489-3d4adcf12f26 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:47.734418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:47.735054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:47.735336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:47.735632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:47.736222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:47.737605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:47.747324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:47.748768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:47.749989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:47.751944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 507/997] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:47.754226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac4de-68a1-4cb9-9b47-e3b67bca9587 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:47.853911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac4de-68a1-4cb9-9b47-e3b67bca9587 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:47.874152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:47.889008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:47.889620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:47.889905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:47.890179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:47.890810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:47.891122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:47.892517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:47.902634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 491/998] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:47.904209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:47.956876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:48.010469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58072ade-aa26-4b0e-8efa-fbdb245f070a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:48.045831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb31c-31f1-47f0-8199-29046ee1a37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:48.046442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb31c-31f1-47f0-8199-29046ee1a37e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.046725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb31c-31f1-47f0-8199-29046ee1a37e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.047000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb31c-31f1-47f0-8199-29046ee1a37e None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.047658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb31c-31f1-47f0-8199-29046ee1a37e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:48.047967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb31c-31f1-47f0-8199-29046ee1a37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:48.049351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb31c-31f1-47f0-8199-29046ee1a37e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:48.059258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 508/999] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:48.060816 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:48.092992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ef8d-f774-4a3f-a33d-2199cf057add None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.093278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ef8d-f774-4a3f-a33d-2199cf057add None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.093555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ef8d-f774-4a3f-a33d-2199cf057add None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.095001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 509/1000] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:48.100091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9bada-c3a8-48b5-b196-2b50266ba8aa None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.100453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9bada-c3a8-48b5-b196-2b50266ba8aa None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.100702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9bada-c3a8-48b5-b196-2b50266ba8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.124129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-6fa9bada-c3a8-48b5-b196-2b50266ba8aa None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:48.124129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6fa9bada-c3a8-48b5-b196-2b50266ba8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:48.175240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e9d51-5031-4611-aae6-9e44c25f1eb0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:48.197779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 510/1001] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:48.212974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3226-aafb-4773-983d-310e0c702f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:48.213588 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3226-aafb-4773-983d-310e0c702f63 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.213865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3226-aafb-4773-983d-310e0c702f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.214135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3226-aafb-4773-983d-310e0c702f63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.214829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3226-aafb-4773-983d-310e0c702f63 None admin] RBAC: Adding query filter params (interface=public, service_id=e2267929f4c0424d831d058bf388d50f, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:48.215167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3226-aafb-4773-983d-310e0c702f63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:48.216539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3226-aafb-4773-983d-310e0c702f63 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:48.226018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 492/1002] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:26:48 2022] GET /identity/v3/endpoints?service_id=e2267929f4c0424d831d058bf388d50f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:48.227297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9bada-c3a8-48b5-b196-2b50266ba8aa None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:48.275720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:48.330690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9bada-c3a8-48b5-b196-2b50266ba8aa None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:48.364349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607da71-9f6e-432a-982a-f4daf862863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:48.364944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607da71-9f6e-432a-982a-f4daf862863e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.365220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607da71-9f6e-432a-982a-f4daf862863e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.365492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607da71-9f6e-432a-982a-f4daf862863e None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.366092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607da71-9f6e-432a-982a-f4daf862863e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:48.367689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607da71-9f6e-432a-982a-f4daf862863e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:48.379695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 511/1003] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:48 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:26:48.379880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662da2eb-243d-440e-92a3-c97ba19931de None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.379880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662da2eb-243d-440e-92a3-c97ba19931de None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.379880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662da2eb-243d-440e-92a3-c97ba19931de None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.379880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 493/1004] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:48.382565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b618-7c15-4824-8ba0-7390c6445701 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.383376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b618-7c15-4824-8ba0-7390c6445701 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.383892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b618-7c15-4824-8ba0-7390c6445701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.403823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3371b618-7c15-4824-8ba0-7390c6445701 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:48.405047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3371b618-7c15-4824-8ba0-7390c6445701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:48.471965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662da2eb-243d-440e-92a3-c97ba19931de None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:48.480527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 512/1005] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:48.526528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:48.584931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662da2eb-243d-440e-92a3-c97ba19931de None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:48.620081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:48.620973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.621256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.621528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.622107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:48.623474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:48.632572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:48.634319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:48.635888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 494/1006] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Sep 5 10:26:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:48.640489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371b618-7c15-4824-8ba0-7390c6445701 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:48.683147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:48.747081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371b618-7c15-4824-8ba0-7390c6445701 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:48.747413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:48.783217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:48.783856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.784139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.784415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.785052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:48.785355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:48.786742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:48.791743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 513/1007] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:48.798081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:48.861422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d783f11-86a8-4117-8994-0c93c8ceee45 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:48.877031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:48.904632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43ba8c-9b3e-45c8-94da-259ced2a1c7d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:48.905482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:48.906231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:48.908066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.908423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.908712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.909417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:48.910838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:48.935642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 495/1008] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:48 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:26:48.950755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980a9cf-6d5f-4fa4-8535-aa9a6d6978cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:48.951384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a9cf-6d5f-4fa4-8535-aa9a6d6978cd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:48.951762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a9cf-6d5f-4fa4-8535-aa9a6d6978cd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:48.952090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a9cf-6d5f-4fa4-8535-aa9a6d6978cd None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:48.952746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980a9cf-6d5f-4fa4-8535-aa9a6d6978cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:48.953052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980a9cf-6d5f-4fa4-8535-aa9a6d6978cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:48.954542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980a9cf-6d5f-4fa4-8535-aa9a6d6978cd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:48.966078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 514/1009] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Sep 5 10:26:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:48.967773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:49.079796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cbd70-4b75-4e4f-8478-e5ea93dbd473 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:49.117516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81869f9-ca38-4d2c-b65b-600746ec63d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:49.118214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81869f9-ca38-4d2c-b65b-600746ec63d7 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:49.118502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81869f9-ca38-4d2c-b65b-600746ec63d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:49.118778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81869f9-ca38-4d2c-b65b-600746ec63d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:49.119464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81869f9-ca38-4d2c-b65b-600746ec63d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:49.121161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81869f9-ca38-4d2c-b65b-600746ec63d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:49.139322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 496/1010] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:50.319110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99b62-296c-4dd4-a272-a847f50c335f None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:50.319815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99b62-296c-4dd4-a272-a847f50c335f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:50.319815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99b62-296c-4dd4-a272-a847f50c335f None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:50.321309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 515/1011] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:50.326251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe216684-fc8a-4e12-ab4c-fbbb19089ed1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:50.326640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe216684-fc8a-4e12-ab4c-fbbb19089ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:50.326801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe216684-fc8a-4e12-ab4c-fbbb19089ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:50.346052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fe216684-fc8a-4e12-ab4c-fbbb19089ed1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:50.347245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fe216684-fc8a-4e12-ab4c-fbbb19089ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:50.374627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:50.427832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 497/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:50.702883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99b62-296c-4dd4-a272-a847f50c335f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:50.838776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99b62-296c-4dd4-a272-a847f50c335f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:50.884569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:50.885212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:50.885638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:50.886133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:50.887109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:50.889065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:50.899662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78595ecd-6621-4c72-8b06-e090be60c3cc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:50.900269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78595ecd-6621-4c72-8b06-e090be60c3cc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:50.900747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78595ecd-6621-4c72-8b06-e090be60c3cc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:50.900876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:50.901822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:50.902683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 516/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:50.905988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 498/1014] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:50.909240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:50.911185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ddd9-2140-4aa7-817e-7fec10032aef None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:50.911749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ddd9-2140-4aa7-817e-7fec10032aef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:50.912245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ddd9-2140-4aa7-817e-7fec10032aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:50.936985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3a44ddd9-2140-4aa7-817e-7fec10032aef None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:50.938622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a44ddd9-2140-4aa7-817e-7fec10032aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:50.947518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:51.023898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 499/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:51.036555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34a3b-2638-412e-aab6-7924b52d875d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.074449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eca77-763f-4ecc-9721-0964f740f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.075064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eca77-763f-4ecc-9721-0964f740f75a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.075349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eca77-763f-4ecc-9721-0964f740f75a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.075646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eca77-763f-4ecc-9721-0964f740f75a None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.076290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eca77-763f-4ecc-9721-0964f740f75a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:51.076647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eca77-763f-4ecc-9721-0964f740f75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.078027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eca77-763f-4ecc-9721-0964f740f75a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.087886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 517/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:51.090375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ddd9-2140-4aa7-817e-7fec10032aef None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.098606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7217b-544a-4ae1-ad8a-206a3170b47b None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.098906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7217b-544a-4ae1-ad8a-206a3170b47b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.099192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7217b-544a-4ae1-ad8a-206a3170b47b None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.100664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 518/1017] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:51.106910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aad91-b454-48d6-9605-be2a61c5374e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.107405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aad91-b454-48d6-9605-be2a61c5374e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.107713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aad91-b454-48d6-9605-be2a61c5374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.133507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-284aad91-b454-48d6-9605-be2a61c5374e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:51.134712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-284aad91-b454-48d6-9605-be2a61c5374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:51.200493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:51.211980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 519/1018] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:51.218808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ddd9-2140-4aa7-817e-7fec10032aef None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.255255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.255923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.256209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.256486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.257126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:51.257435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.259893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.265194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 500/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Sep 5 10:26:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:51.270687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aad91-b454-48d6-9605-be2a61c5374e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.294622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:51.304619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.383337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aad91-b454-48d6-9605-be2a61c5374e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.423988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.424607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.424889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.425167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.425860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.427250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.432872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafa1a2-964b-4d4b-8cec-817483c8869c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.451383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 520/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:26:51.483625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.484274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.484560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.484837 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.485436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.486863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.494560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:51.497965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:51.498987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:51.500310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:51.503782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 501/1021] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Sep 5 10:26:51 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:51.507224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.525219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:51.595611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:51.627022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd819d7-9f40-40ab-8fdb-a8ae7ebaed6b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.629954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152ea3d-2206-4aaf-ad50-b92ec0e41762 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.668978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.669596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.669879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.670152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.670786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] RBAC: Adding query filter params (name=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:51.671091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.671300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.671970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.672251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.673208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.673314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.673629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.675052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.676645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 521/1022] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:51.682420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.683409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 502/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:51.689069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.775992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:51.795565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055111a-f322-4e25-adff-a890c4e12449 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.801811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1939e-740a-419b-9732-32afefeb9033 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:51.835056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.835699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.836710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.837065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.837785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.839229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.840436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:51.841047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:51.841357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:51.841659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:51.842262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:51.842566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:51.843948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:51.849080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 503/1024] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:51.855736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:51.859521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:51.878638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 522/1025] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:26:51 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:26:51.967529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e634f2-d9de-4667-9fcb-1d5f3c342263 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:52.003506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b99c6-6d70-4a30-b198-62dfbf211367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:52.004151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b99c6-6d70-4a30-b198-62dfbf211367 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:52.004432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b99c6-6d70-4a30-b198-62dfbf211367 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:52.004704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b99c6-6d70-4a30-b198-62dfbf211367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:52.005433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b99c6-6d70-4a30-b198-62dfbf211367 None admin] RBAC: Adding query filter params (interface=public, service_id=3c536c2d9809467589630cb0640a8bbc, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:52.005743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b99c6-6d70-4a30-b198-62dfbf211367 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:52.007198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b99c6-6d70-4a30-b198-62dfbf211367 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:52.015312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 504/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:26:51 2022] GET /identity/v3/endpoints?service_id=3c536c2d9809467589630cb0640a8bbc&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:52.020047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:52.135245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda0dd-844a-44e8-9300-4b0034b4c0ea None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:52.172237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82117803-ee71-49e1-b228-b1390bac32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:52.172852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117803-ee71-49e1-b228-b1390bac32fc None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:52.173132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117803-ee71-49e1-b228-b1390bac32fc None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:52.173405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82117803-ee71-49e1-b228-b1390bac32fc None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:52.174015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82117803-ee71-49e1-b228-b1390bac32fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:52.175389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82117803-ee71-49e1-b228-b1390bac32fc None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:52.182516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 523/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:26:52 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:26:53.496210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195fdc-f8d1-41e7-bc30-793308b3d681 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:53.496733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195fdc-f8d1-41e7-bc30-793308b3d681 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:53.496823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195fdc-f8d1-41e7-bc30-793308b3d681 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:53.498259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 505/1028] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:53.503394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b55d7-ca6f-42b1-bd15-a2845c0bee6a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:53.503868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b55d7-ca6f-42b1-bd15-a2845c0bee6a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:53.504031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b55d7-ca6f-42b1-bd15-a2845c0bee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:53.523032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7d1b55d7-ca6f-42b1-bd15-a2845c0bee6a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:53.525146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7d1b55d7-ca6f-42b1-bd15-a2845c0bee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:53.582998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:53.596375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 524/1029] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:53.846053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c062a6-c7b0-4e52-994c-3ce0dcf82111 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:53.846252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c062a6-c7b0-4e52-994c-3ce0dcf82111 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:53.846521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c062a6-c7b0-4e52-994c-3ce0dcf82111 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:53.847936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 506/1030] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:53.853319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd91dbf-1ee2-4490-9086-6c0bb18994ea None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:53.853693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd91dbf-1ee2-4490-9086-6c0bb18994ea None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:53.854041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd91dbf-1ee2-4490-9086-6c0bb18994ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:53.870382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c062a6-c7b0-4e52-994c-3ce0dcf82111 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:53.873028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-8cd91dbf-1ee2-4490-9086-6c0bb18994ea None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:53.874203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8cd91dbf-1ee2-4490-9086-6c0bb18994ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:53.874449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:53.943800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 525/1031] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:53.978393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c062a6-c7b0-4e52-994c-3ce0dcf82111 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.013085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd46076-f203-46d8-b4db-8a22706e2a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.013711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46076-f203-46d8-b4db-8a22706e2a87 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.013988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46076-f203-46d8-b4db-8a22706e2a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.014255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46076-f203-46d8-b4db-8a22706e2a87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.024237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd46076-f203-46d8-b4db-8a22706e2a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-6bd46076-f203-46d8-b4db-8a22706e2a87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:54.029013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:54.029939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:54.030932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 507/1032] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Sep 5 10:26:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:54.036063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd91dbf-1ee2-4490-9086-6c0bb18994ea None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.099369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c55d-3ce7-491d-b5d6-fc993bfebe17 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.099583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c55d-3ce7-491d-b5d6-fc993bfebe17 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.099895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c55d-3ce7-491d-b5d6-fc993bfebe17 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.101429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 508/1033] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:54.106121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa563ac1-ddca-443c-9891-d1368976c891 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.106413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa563ac1-ddca-443c-9891-d1368976c891 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.106697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa563ac1-ddca-443c-9891-d1368976c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.126231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fa563ac1-ddca-443c-9891-d1368976c891 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:54.127451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa563ac1-ddca-443c-9891-d1368976c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:54.154343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd91dbf-1ee2-4490-9086-6c0bb18994ea None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.177598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:54.193659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.194536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.195006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.195381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.196273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:54.196550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:54.196661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.197943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.207635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 509/1034] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:54.207809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 526/1035] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:54.213136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa563ac1-ddca-443c-9891-d1368976c891 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.216422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.317008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa563ac1-ddca-443c-9891-d1368976c891 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.321876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ea0e-7d94-4a6a-a32a-3fe27c6e7a99 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.352899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.353580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.353874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.354146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.358594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.359223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.359504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.359806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.360918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.363148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.364600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.367649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 527/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:54.367790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.371339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:54.382972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:54.384090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:54.385209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:54.385209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:54.385209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:54.389475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 510/1037] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:54.390308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.428709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:54.441847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:54.489383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d28d-8706-43af-94eb-ebc30ea3a53b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.499188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19d81-d7c7-41a2-ab83-e02c70a1d6ed None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.524898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.525509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.525788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.526060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.526701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.528171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.533228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.533826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.534103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.534374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.535000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:54.535299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.537076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.549017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 511/1038] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:54.549823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.555822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 528/1039] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:26:54 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:26:54.556852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.671413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f0da8-b582-4d8c-8ce1-41178df8b6d7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.677371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8181-27a4-476f-8d60-a9d1b0841c6e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.681804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:54.686761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:54.719317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.719867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.720049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.720332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.720512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.720613 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] PATH_INFO: `/v3/services/image` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.720791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.721061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.721213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.723204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.729341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.730789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:54.732792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:54.733754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:54.734637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 512/1040] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:54.740233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:54.744600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:54.745800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:54.747388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 529/1041] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:54.751521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.860082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e362-6d2b-472b-82ca-98c0b4abc083 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.865801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ea52-734f-4e2c-ad02-89969a5c60f1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:54.896980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.897595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.897882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.898687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.899395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] RBAC: Adding query filter params (name=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:54.899741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.901154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.901259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:54.901850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:54.902146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:54.902407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:54.903138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:54.903453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:54.904938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:54.906567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 513/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:54.912263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.924803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 530/1043] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:54.931105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:54.950755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:54.956583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:55.024339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ebe0-66a3-4fcd-a549-d26cf0ae630a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:55.035923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c4d5-13d8-436c-aca5-19ba90c707b3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:55.061438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:55.062077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:55.062344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:55.062624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:55.063252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] RBAC: Adding query filter params (type=image) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:55.063555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:55.064960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:55.075024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 514/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:55.076563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:55.079697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:55.080405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:55.080757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:55.081042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:55.162895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:55.164469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:55.182514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:55.186977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c236e02-3102-469e-8ed2-add5e1cfdafd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:55.189427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:55.224748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:55.225357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:55.225637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:55.225913 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:55.226733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:55.228206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:55.249774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 515/1045] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:26:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:26:55.272647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 531/1046] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:26:55.279129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:55.396046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810a56-0d3a-4f11-9b4f-6c5e445ba158 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:55.430444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:55.431162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:55.431446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:55.431752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:55.442557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:55.444000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:55.459630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:55.460724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:55.461917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:55.461917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:55.461917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:55.461917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 516/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:55.468486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:55.570757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c5a50-8085-415d-8644-e1c5cfffdeda None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:55.594953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:55.607024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:55.607675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:55.607962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:55.608238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:55.608890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:55.609196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:55.610576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:55.627735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 532/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:55.629082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:55.632120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:55.737296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076081cc-8450-4f59-aa3b-009a076e36a7 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:55.771467 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:55.772133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:55.772417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:55.772692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:55.779356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:55.780832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:55.793034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:55.793925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:55.799950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 517/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:55.800558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:55.901289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb3949-4dd8-40e1-bcc5-68644e40bc84 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:55.935036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe35884-3413-4da2-9094-ccb3b1baaac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:55.935743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35884-3413-4da2-9094-ccb3b1baaac7 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:55.936029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35884-3413-4da2-9094-ccb3b1baaac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:55.936305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe35884-3413-4da2-9094-ccb3b1baaac7 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:55.936998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe35884-3413-4da2-9094-ccb3b1baaac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:55.937308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe35884-3413-4da2-9094-ccb3b1baaac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:55.938751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe35884-3413-4da2-9094-ccb3b1baaac7 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:55.956484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 533/1050] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:55.957902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:56.019461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:56.059893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e229aa-3ec9-455a-b95b-ef8badeb7a5c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:56.098653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd17f0f-7bde-4d5e-9764-8d584dd90ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:56.099264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd17f0f-7bde-4d5e-9764-8d584dd90ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:56.099551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd17f0f-7bde-4d5e-9764-8d584dd90ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:56.099860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd17f0f-7bde-4d5e-9764-8d584dd90ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:56.100594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd17f0f-7bde-4d5e-9764-8d584dd90ff5 None admin] RBAC: Adding query filter params (role.id=181f9c6b82db4e06923f47023777c94f, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=bc87886676534d46bee21984a515c138) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:56.100908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd17f0f-7bde-4d5e-9764-8d584dd90ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:56.102680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd17f0f-7bde-4d5e-9764-8d584dd90ff5 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:56.108255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 518/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:55 2022] GET /identity/v3/role_assignments?user.id=bc87886676534d46bee21984a515c138&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=181f9c6b82db4e06923f47023777c94f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:56.546941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4b8d5-ffd3-4233-a32b-b4ed93f37a57 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:56.547334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4b8d5-ffd3-4233-a32b-b4ed93f37a57 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:56.547614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4b8d5-ffd3-4233-a32b-b4ed93f37a57 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:56.548939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 534/1052] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:56.554141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ede5e-462b-4814-8ad6-a592407b4297 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:56.554526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ede5e-462b-4814-8ad6-a592407b4297 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:56.554866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ede5e-462b-4814-8ad6-a592407b4297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:56.573356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fe3ede5e-462b-4814-8ad6-a592407b4297 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:56.574530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fe3ede5e-462b-4814-8ad6-a592407b4297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:56.643279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 519/1053] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:26:56.908030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4b8d5-ffd3-4233-a32b-b4ed93f37a57 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:56.956940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:57.014880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4b8d5-ffd3-4233-a32b-b4ed93f37a57 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:57.050086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2455a-a508-4cf0-980d-2fc60837fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:57.050716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2455a-a508-4cf0-980d-2fc60837fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.050994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2455a-a508-4cf0-980d-2fc60837fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.051269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2455a-a508-4cf0-980d-2fc60837fdb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.061806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2455a-a508-4cf0-980d-2fc60837fdb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-2ab2455a-a508-4cf0-980d-2fc60837fdb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:57.066688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:57.067619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:26:57.068491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:57.076591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 535/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:57.076745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ede5e-462b-4814-8ad6-a592407b4297 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:57.140631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:57.189424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ede5e-462b-4814-8ad6-a592407b4297 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:57.218876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb8825-f92c-467d-8410-58ffe80d1142 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.219165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb8825-f92c-467d-8410-58ffe80d1142 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.219436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb8825-f92c-467d-8410-58ffe80d1142 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.221538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 536/1055] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:57.225617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:57.226324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.226445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641aa1-e820-4345-a556-ab673114ddd1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.226626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641aa1-e820-4345-a556-ab673114ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.226784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.226948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23641aa1-e820-4345-a556-ab673114ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.227040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.227756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:57.228064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:57.229423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:57.243529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 520/1056] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:26:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:57.244597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:57.245149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-23641aa1-e820-4345-a556-ab673114ddd1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:57.246610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-23641aa1-e820-4345-a556-ab673114ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:57.323885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 537/1057] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:57.347330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887ec04-d366-4e90-8d82-a4b97c33064d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:57.364352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:57.382965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:57.383720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.384007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.384279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] PATH_INFO: `/v3/users/d55b578807f841b39160ea69bea03188` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.397213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=d55b578807f841b39160ea69bea03188)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:57.398806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:57.405470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 521/1058] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:26:57 2022] GET /identity/v3/users/d55b578807f841b39160ea69bea03188 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:57.406723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23641aa1-e820-4345-a556-ab673114ddd1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:57.442414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:57.510723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23641aa1-e820-4345-a556-ab673114ddd1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:57.545278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:57.545898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.546180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.546458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.587191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:57.618260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:57.619859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:57.655519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:57.695670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1f863-ef80-4c1a-b82f-e60c75489cd3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:57.728508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 538/1059] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:26:57.734116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:57.737974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:57.738582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.738859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.739129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.788270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:57.813298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:57.814776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:57.840356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898c5ca-22a9-4446-82f3-a4670ff4f7c1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:57.876825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:57.877467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:57.877752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:57.878030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:57.879159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] RBAC: Authorizing `identity:get_project(project_id=503c417da8744c7da3014db52bfcf5ba)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:57.880637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:57.882259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 539/1060] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:26:57 2022] GET /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:57.888235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:57.891034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:57.925475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 522/1061] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:26:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:26:57.931668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:58.001425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973daf6-631c-42ac-bf0a-3784521e8137 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:58.009594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:58.034301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25231-fd01-4785-ae50-b1b82fba187c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:58.038233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5520d0-84ae-4628-89df-f0ff4f35ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:58.038863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5520d0-84ae-4628-89df-f0ff4f35ab2f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.039141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5520d0-84ae-4628-89df-f0ff4f35ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.039415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5520d0-84ae-4628-89df-f0ff4f35ab2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.040171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5520d0-84ae-4628-89df-f0ff4f35ab2f None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=503c417da8744c7da3014db52bfcf5ba, user.id=d55b578807f841b39160ea69bea03188) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:58.040480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5520d0-84ae-4628-89df-f0ff4f35ab2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:58.041956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5520d0-84ae-4628-89df-f0ff4f35ab2f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:58.047190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 540/1062] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:26:57 2022] GET /identity/v3/role_assignments?user.id=d55b578807f841b39160ea69bea03188&scope.project.id=503c417da8744c7da3014db52bfcf5ba&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:58.048351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf5f0-2a36-414d-aad3-d112cfc03f3e None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.048635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf5f0-2a36-414d-aad3-d112cfc03f3e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.048911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871cf5f0-2a36-414d-aad3-d112cfc03f3e None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.050100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 541/1063] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:26:58.055704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303ad2-df1b-4e1f-9441-6446bced5005 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.055992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303ad2-df1b-4e1f-9441-6446bced5005 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.056263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303ad2-df1b-4e1f-9441-6446bced5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.076752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-38303ad2-df1b-4e1f-9441-6446bced5005 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:58.077980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-38303ad2-df1b-4e1f-9441-6446bced5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:26:58.087521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:58.087521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.087521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.087521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.098756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:58.100312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:58.120152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:58.121489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:58.122417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:58.122417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:58.122417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:26:58.122417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 523/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:58.127978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:58.156179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:58.167676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 542/1065] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:26:58.241425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8102ff-818c-4c1b-b814-241fe6e41370 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:58.269170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:58.278488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:58.279099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.279383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.279688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.280329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:58.280636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:58.282010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:58.299625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 524/1066] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:58.443664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38303ad2-df1b-4e1f-9441-6446bced5005 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:58.552043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38303ad2-df1b-4e1f-9441-6446bced5005 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:58.589493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:58.590130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.590411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.590685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.600588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:26:58.605399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:58.606505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:58.607376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 543/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Sep 5 10:26:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:26:58.612630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:58.712726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad4d25-c3b3-4026-8a0a-850b2efbaf6b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:58.744943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:58.745799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.746080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.746355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.747012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:58.747318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:58.748712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:58.756381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 525/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Sep 5 10:26:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:58.762529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:58.817383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:58.860288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15485a-8c5f-4438-b45b-9dfebfb77c30 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:58.893761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:58.894387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:58.894668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:58.894944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:58.904856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:58.906300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:58.921714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:58.922837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:58.924033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:58.924033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:58.924033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:58.924033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 544/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:58.928483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:58.979058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:59.030205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfeb8b-2935-4fa1-af78-9382cdb6f19a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:59.064209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:59.064815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.065099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.065376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.066013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:59.066318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:59.067762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:59.079273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 526/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:26:59.084703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:59.192938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3fb2-c7ff-4501-bad4-5e134d3eb9ca None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:59.202216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:59.226819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:59.227445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.227779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.228055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.235229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:59.236694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:26:59.248396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:59.249486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:59.250866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 545/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:26:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:59.255195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:59.353920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bbc59-d4e5-436d-bca0-328434e5d9ed None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:59.364539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:59.390762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:59.391367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.391680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.391960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.392681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:59.392990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:59.394413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:59.411385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 527/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:26:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:59.417789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:59.519080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4a9b5-d335-4be4-9c46-7ab53a3fd1b6 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:59.552891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:59.553517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.553798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.554073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.564738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:59.566196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:26:59.580967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:59.581958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:26:59.582859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:26:59.582859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:26:59.582859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:59.582859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 546/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:59.588691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:59.686407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b302f9f-38ea-4b1c-9a99-8d8bc1c8a6a4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:59.720117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:59.720724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.720986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.721260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.721998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:26:59.722302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:59.723808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:59.734899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 528/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:26:59.740513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:59.762996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:59.840160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c3839-2bb9-41a0-ad0c-daf2cec4124d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:26:59.873751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502293-4cec-4e93-b926-1e6d6bb8d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:26:59.874380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502293-4cec-4e93-b926-1e6d6bb8d946 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.874665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502293-4cec-4e93-b926-1e6d6bb8d946 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.874941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502293-4cec-4e93-b926-1e6d6bb8d946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.881524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04502293-4cec-4e93-b926-1e6d6bb8d946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:26:59.883721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04502293-4cec-4e93-b926-1e6d6bb8d946 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-04502293-4cec-4e93-b926-1e6d6bb8d946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:26:59.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:26:59.895741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:26:59.896665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 547/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:26:59.901997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:26:59.930276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:26:59.952244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee37f3-6e04-428b-bcbb-fc64f6a0304a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.952457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee37f3-6e04-428b-bcbb-fc64f6a0304a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.952729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee37f3-6e04-428b-bcbb-fc64f6a0304a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.954059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 548/1076] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:26:59.959135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ce036-186e-4a63-a2e2-ead7f2c6562d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:26:59.959424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ce036-186e-4a63-a2e2-ead7f2c6562d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:26:59.959732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ce036-186e-4a63-a2e2-ead7f2c6562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:26:59.977862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-935ce036-186e-4a63-a2e2-ead7f2c6562d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:26:59.979055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-935ce036-186e-4a63-a2e2-ead7f2c6562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:00.001929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea124c5-8015-461a-a606-07586bd094a0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:00.036735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:00.037341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:00.037620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:00.037898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:00.038623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:00.038938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:00.040387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:00.047250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 549/1077] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:26:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:27:00.052216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 529/1078] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:00.058814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ce036-186e-4a63-a2e2-ead7f2c6562d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:00.071112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:00.161591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ce036-186e-4a63-a2e2-ead7f2c6562d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:00.197473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:00.198121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:00.198399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:00.198672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/bc87886676534d46bee21984a515c138/roles/181f9c6b82db4e06923f47023777c94f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:00.200803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=bc87886676534d46bee21984a515c138, role_id=181f9c6b82db4e06923f47023777c94f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:00.202236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:00.215805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 550/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:27:00 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/bc87886676534d46bee21984a515c138/roles/181f9c6b82db4e06923f47023777c94f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:27:00.325795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:00.416390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:00.428400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631345b-a45c-4493-b7c1-f4ee06c0807f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:00.463509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:00.464167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:00.464452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:00.464728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:00.474508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:00.479361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:00.480523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:27:00.481390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 530/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:00.486457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:00.556658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:00.588563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851a45-7703-474d-a129-58f842c7a545 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:00.622257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:00.622859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:00.623138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:00.623410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:00.624106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:00.624407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:00.625775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:00.634615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 551/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:00.640442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:00.737170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34997ea5-2e14-4db1-8746-35a1b59a554c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:00.770953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:00.771575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:00.771893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:00.772169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] PATH_INFO: `/v3/users/d55b578807f841b39160ea69bea03188` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:00.773520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] RBAC: Authorizing `identity:get_user(user_id=d55b578807f841b39160ea69bea03188)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:00.774952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:00.776730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 531/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:00 2022] GET /identity/v3/users/d55b578807f841b39160ea69bea03188 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:00.782349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:00.880361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7265c0-8f96-46a2-bd37-492e0478eada None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:00.908889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:00.914723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697ba96-9bfe-445c-8eab-77563113f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:00.915350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697ba96-9bfe-445c-8eab-77563113f6cd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:00.915655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697ba96-9bfe-445c-8eab-77563113f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:00.915933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697ba96-9bfe-445c-8eab-77563113f6cd None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:00.917043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697ba96-9bfe-445c-8eab-77563113f6cd None admin] RBAC: Authorizing `identity:get_project(project_id=503c417da8744c7da3014db52bfcf5ba)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:00.918470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697ba96-9bfe-445c-8eab-77563113f6cd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:00.920125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 552/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:00 2022] GET /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:00.926085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:00.946251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:01.026526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125a73-8aaf-4f0a-a76a-9a372de2b81b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:01.060601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5f987-818b-46b3-8623-63db94af1155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:01.061261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f987-818b-46b3-8623-63db94af1155 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:01.061545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f987-818b-46b3-8623-63db94af1155 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:01.061824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f987-818b-46b3-8623-63db94af1155 None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba/users/d55b578807f841b39160ea69bea03188/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:01.063746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5f987-818b-46b3-8623-63db94af1155 None admin] RBAC: Authorizing `identity:create_grant(project_id=503c417da8744c7da3014db52bfcf5ba, user_id=d55b578807f841b39160ea69bea03188, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:01.065193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5f987-818b-46b3-8623-63db94af1155 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:01.077639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 532/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:27:00 2022] PUT /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba/users/d55b578807f841b39160ea69bea03188/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:27:02.095701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d833e82-3245-4803-8491-c60ce6d19021 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:02.096231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d833e82-3245-4803-8491-c60ce6d19021 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:02.096231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d833e82-3245-4803-8491-c60ce6d19021 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:02.097554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 553/1085] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:02.102685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea2a2d-f5b5-4f4b-8667-2dc4a2c73370 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:02.103111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea2a2d-f5b5-4f4b-8667-2dc4a2c73370 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:02.103238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea2a2d-f5b5-4f4b-8667-2dc4a2c73370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:02.122821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-00ea2a2d-f5b5-4f4b-8667-2dc4a2c73370 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:02.124055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-00ea2a2d-f5b5-4f4b-8667-2dc4a2c73370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:02.192577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 533/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:02.463629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d833e82-3245-4803-8491-c60ce6d19021 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:02.566957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d833e82-3245-4803-8491-c60ce6d19021 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:02.600371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:02.601567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:02.601853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:02.602131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:02.612180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:02.617618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:02.618671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:02.619942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 554/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Sep 5 10:27:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:02.625088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea2a2d-f5b5-4f4b-8667-2dc4a2c73370 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:02.633401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:02.723050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea2a2d-f5b5-4f4b-8667-2dc4a2c73370 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:02.756781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:02.757425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:02.757702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:02.757978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:02.758637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:02.758943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:02.760333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:02.768134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 534/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Sep 5 10:27:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:02.773958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:02.832677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:02.873893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf54fa-7684-487d-bafc-b6d918c26a20 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:02.907540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9e7ce-6898-41ea-95c9-5eb82719313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:02.908193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e7ce-6898-41ea-95c9-5eb82719313e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:02.908474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e7ce-6898-41ea-95c9-5eb82719313e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:02.908751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9e7ce-6898-41ea-95c9-5eb82719313e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:02.919196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9e7ce-6898-41ea-95c9-5eb82719313e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:02.920677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9e7ce-6898-41ea-95c9-5eb82719313e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-2aa9e7ce-6898-41ea-95c9-5eb82719313e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:27:02.936077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:02.938006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:27:02.939846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:27:02.939846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:27:02.939846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:02.939846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 555/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:02.943236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:02.999419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c154c2c-7c7d-4ffa-88b3-9869e41ef55c None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:02.999740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c154c2c-7c7d-4ffa-88b3-9869e41ef55c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.000019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c154c2c-7c7d-4ffa-88b3-9869e41ef55c None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.001359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 556/1090] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:27:03.006363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c5330-d815-4a42-bc93-662120b8982a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.006718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c5330-d815-4a42-bc93-662120b8982a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.007025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c5330-d815-4a42-bc93-662120b8982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.012741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.025904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-848c5330-d815-4a42-bc93-662120b8982a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:03.027097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-848c5330-d815-4a42-bc93-662120b8982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:03.048974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8462-655f-4b54-ba1e-172b2e708ce3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.082115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.082711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.082991 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.083262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.083928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:03.084231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:03.086310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:03.094631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 557/1091] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 10:27:03.104252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 535/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:03.105801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c5330-d815-4a42-bc93-662120b8982a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.151533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.214358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c5330-d815-4a42-bc93-662120b8982a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.247714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.248344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.248627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.248902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.255772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:03.257657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:27:03.269067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:03.270053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:03.271402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 558/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:03.276824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.362956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.374116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5556ac-b65e-4e2b-9a06-ca83a12c2a15 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.402512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.410253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.410866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.411150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.411426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.412191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:03.412505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:03.413970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:03.430969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 536/1094] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:03.436800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.465938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774d1fb-81d1-40cc-9050-8808e24dffad None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.467508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.500132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.500841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.501149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.501423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.512263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:03.516931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:03.517941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:03.519110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 559/1095] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:03.524496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.538102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0b6ca-2277-4048-afb2-d9557f646eb4 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.573354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.573960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.574245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.574521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.622549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ecb2-a18b-4591-ae60-160949554975 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.626962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.640967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:03.642421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:03.656359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.656961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.657243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.657518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.658175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:03.658476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:03.659873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:03.668401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 560/1096] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:03.674041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.699772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.741650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 537/1097] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:27:03.747663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.774851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4191f8-6d85-4c80-991d-49cee1dbb606 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.808395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.809017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.809297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.809568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] PATH_INFO: `/v3/users/d55b578807f841b39160ea69bea03188` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.810691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] RBAC: Authorizing `identity:get_user(user_id=d55b578807f841b39160ea69bea03188)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:03.812167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:03.813721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 561/1098] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/users/d55b578807f841b39160ea69bea03188 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:03.819370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.832874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.848811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84830e73-7825-49c7-be4a-e3a3283325cc None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.882908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.883544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.883859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.884130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:03.893841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:03.895278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:27:03.910010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:03.911117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:27:03.912380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:27:03.912380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:27:03.912380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:27:03.912380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 538/1099] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:27:03.914109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:03.917342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:03.922239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c3d6-bb98-4719-854a-805585ab6d02 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:03.956678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:03.957280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:03.957555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:03.957830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:04.014742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0919b-7051-416f-aa2b-d5be991a3768 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:04.026598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:04.028057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:04.052595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:04.053200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:04.053482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:04.053767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:04.054568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:04.054871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:04.056288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:04.063068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:04.070558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 539/1100] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:04.076100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:04.118373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:04.131375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 562/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:27:04.137865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:04.180769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37697b-bfeb-46d9-9ac0-65f14c4af565 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:04.214955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:04.215584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:04.215905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:04.216182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:04.222659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:04.224129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:27:04.235982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:04.236890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:27:04.237998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 540/1102] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:27:04.238753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c330af1-32a0-42c4-9894-acf73496e00d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:04.242810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:04.274168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:04.274798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:04.275084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:04.275362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:04.276507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] RBAC: Authorizing `identity:get_project(project_id=503c417da8744c7da3014db52bfcf5ba)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:04.278028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:04.279604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 563/1103] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:04 2022] GET /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:04.285471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:04.300799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:04.342484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a02138-e0ce-4baa-9ba0-d4dd2ec5289c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:04.343474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:04.377079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:04.377672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:04.377954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:04.378227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:04.379137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:04.379346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:04.380649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:04.385245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4c64-48b0-4f22-809d-93b83d20afd3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:04.393149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 541/1104] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:04.399304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:04.419040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8946c40-0a81-41e8-ac09-5d2c4e915abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:04.419677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946c40-0a81-41e8-ac09-5d2c4e915abf None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:04.419968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946c40-0a81-41e8-ac09-5d2c4e915abf None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:04.420247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946c40-0a81-41e8-ac09-5d2c4e915abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:04.420976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946c40-0a81-41e8-ac09-5d2c4e915abf None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=503c417da8744c7da3014db52bfcf5ba, user.id=d55b578807f841b39160ea69bea03188) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:04.421287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946c40-0a81-41e8-ac09-5d2c4e915abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:04.422722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946c40-0a81-41e8-ac09-5d2c4e915abf None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:04.428455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 564/1105] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:04 2022] GET /identity/v3/role_assignments?user.id=d55b578807f841b39160ea69bea03188&scope.project.id=503c417da8744c7da3014db52bfcf5ba&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:04.502636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9457bd-89ee-498a-98a8-f5d00c976dbf None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:04.521731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:04.540625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d34ef3-6043-4d3b-9e90-ce4f40f6ab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:04.541230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34ef3-6043-4d3b-9e90-ce4f40f6ab55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:04.541640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34ef3-6043-4d3b-9e90-ce4f40f6ab55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:04.541924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34ef3-6043-4d3b-9e90-ce4f40f6ab55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:04.542673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34ef3-6043-4d3b-9e90-ce4f40f6ab55 None admin] RBAC: Adding query filter params (role.id=181f9c6b82db4e06923f47023777c94f, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=bc87886676534d46bee21984a515c138) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:04.542981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34ef3-6043-4d3b-9e90-ce4f40f6ab55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:04.544542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34ef3-6043-4d3b-9e90-ce4f40f6ab55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:04.550961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 542/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:04 2022] GET /identity/v3/role_assignments?user.id=bc87886676534d46bee21984a515c138&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=181f9c6b82db4e06923f47023777c94f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:06.375127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7842f-3090-4138-872d-f735eff24afc None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:06.375651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7842f-3090-4138-872d-f735eff24afc None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:06.375651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7842f-3090-4138-872d-f735eff24afc None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:06.376952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 565/1107] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:06.382141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97cffb-24a5-4d12-9bef-ec0822777d95 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:06.382542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97cffb-24a5-4d12-9bef-ec0822777d95 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:06.382706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97cffb-24a5-4d12-9bef-ec0822777d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:06.400328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1c97cffb-24a5-4d12-9bef-ec0822777d95 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:06.401524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1c97cffb-24a5-4d12-9bef-ec0822777d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:06.465891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 543/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:06.733714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7842f-3090-4138-872d-f735eff24afc None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:06.832787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7842f-3090-4138-872d-f735eff24afc None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:06.857318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:06.867866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786eacc-536b-4f85-944c-889bfe1fa72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:06.868487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786eacc-536b-4f85-944c-889bfe1fa72f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:06.868767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786eacc-536b-4f85-944c-889bfe1fa72f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:06.869038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786eacc-536b-4f85-944c-889bfe1fa72f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:06.870133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786eacc-536b-4f85-944c-889bfe1fa72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:06.871858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786eacc-536b-4f85-944c-889bfe1fa72f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:06.873387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 566/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:06.879110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97cffb-24a5-4d12-9bef-ec0822777d95 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:06.976479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97cffb-24a5-4d12-9bef-ec0822777d95 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:06.989155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:07.010455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb1e72-99bb-4188-a9a0-a39db41af0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:07.011054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1e72-99bb-4188-a9a0-a39db41af0c2 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:07.011338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1e72-99bb-4188-a9a0-a39db41af0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:07.011636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1e72-99bb-4188-a9a0-a39db41af0c2 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:07.012292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb1e72-99bb-4188-a9a0-a39db41af0c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:07.013720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb1e72-99bb-4188-a9a0-a39db41af0c2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:07.034665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 544/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:27:06 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:27:08.968645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a96d-435b-4771-8ca5-dd93b16645c3 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:08.969276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a96d-435b-4771-8ca5-dd93b16645c3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:08.969276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7a96d-435b-4771-8ca5-dd93b16645c3 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:08.970501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 567/1111] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:08.975484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951c67-3708-4f89-94c4-fb9eb335f958 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:08.976693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951c67-3708-4f89-94c4-fb9eb335f958 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:08.976975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951c67-3708-4f89-94c4-fb9eb335f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:08.995806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6c951c67-3708-4f89-94c4-fb9eb335f958 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:08.996989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c951c67-3708-4f89-94c4-fb9eb335f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:09.061257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 545/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:09.334337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7a96d-435b-4771-8ca5-dd93b16645c3 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:09.433942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7a96d-435b-4771-8ca5-dd93b16645c3 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:09.469878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:09.470496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:09.470776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:09.471052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] PATH_INFO: `/v3/roles/916c024b775b4858ba18c731196163a6` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:09.472470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] RBAC: Authorizing `identity:get_role(role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:09.473857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:09.475153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 568/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:09 2022] GET /identity/v3/roles/916c024b775b4858ba18c731196163a6 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:09.480890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951c67-3708-4f89-94c4-fb9eb335f958 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:09.574451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:09.578425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951c67-3708-4f89-94c4-fb9eb335f958 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:09.612149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:09.612714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:09.612999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:09.613312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] PATH_INFO: `/v3/users/4d150ba5d7854e26a167f817e6010827` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:09.626674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] RBAC: Authorizing `identity:get_user(user_id=4d150ba5d7854e26a167f817e6010827)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:09.628149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:09.629744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 546/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:09 2022] GET /identity/v3/users/4d150ba5d7854e26a167f817e6010827 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:09.636405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:09.693634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:09.733278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813452b-101c-4eda-9fc9-a98e648ad3df None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:09.766908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:09.767500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:09.767809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:09.768087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:09.833362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:09.834809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:09.890695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:09.934041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 569/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:27:09.940004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:10.036024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0771d10-5252-4eef-9612-52b61d66d9ba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:10.068075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ee474-6178-4fbf-8f93-047fb4f1e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:10.068687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ee474-6178-4fbf-8f93-047fb4f1e447 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:10.068969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ee474-6178-4fbf-8f93-047fb4f1e447 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:10.069243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ee474-6178-4fbf-8f93-047fb4f1e447 None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:10.071119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ee474-6178-4fbf-8f93-047fb4f1e447 None admin] RBAC: Authorizing `identity:get_project(project_id=503c417da8744c7da3014db52bfcf5ba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:10.072570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ee474-6178-4fbf-8f93-047fb4f1e447 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:10.074174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 547/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:09 2022] GET /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:10.080189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:10.178833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30116c-5b0d-49d4-b8f0-08b49ab859e0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:10.212785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cf00d-595c-445d-bb4f-f3da8e2a18b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:10.213375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cf00d-595c-445d-bb4f-f3da8e2a18b5 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:10.213652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cf00d-595c-445d-bb4f-f3da8e2a18b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:10.213921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cf00d-595c-445d-bb4f-f3da8e2a18b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:10.214638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cf00d-595c-445d-bb4f-f3da8e2a18b5 None admin] RBAC: Adding query filter params (role.id=916c024b775b4858ba18c731196163a6, scope.project.id=503c417da8744c7da3014db52bfcf5ba, user.id=4d150ba5d7854e26a167f817e6010827) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:10.214944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cf00d-595c-445d-bb4f-f3da8e2a18b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:10.216400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cf00d-595c-445d-bb4f-f3da8e2a18b5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:10.221516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 570/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:10 2022] GET /identity/v3/role_assignments?user.id=4d150ba5d7854e26a167f817e6010827&scope.project.id=503c417da8744c7da3014db52bfcf5ba&role.id=916c024b775b4858ba18c731196163a6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:12.068661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203def-dd8a-46e8-81a6-abcd253242e3 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:12.069305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203def-dd8a-46e8-81a6-abcd253242e3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:12.069305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203def-dd8a-46e8-81a6-abcd253242e3 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:12.071200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 548/1118] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:12.076252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818942-88d1-4a31-b158-03c3defbcb5c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:12.076676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818942-88d1-4a31-b158-03c3defbcb5c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:12.076809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f818942-88d1-4a31-b158-03c3defbcb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:12.095068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-6f818942-88d1-4a31-b158-03c3defbcb5c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:12.096272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6f818942-88d1-4a31-b158-03c3defbcb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:12.113176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:12.165463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 571/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:12.437495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16203def-dd8a-46e8-81a6-abcd253242e3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:12.463392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:12.538336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16203def-dd8a-46e8-81a6-abcd253242e3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:12.571777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:12.572391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:12.572676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:12.572955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] PATH_INFO: `/v3/roles/916c024b775b4858ba18c731196163a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:12.574328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] RBAC: Authorizing `identity:get_role(role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:12.575713 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:12.577025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 549/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:12 2022] GET /identity/v3/roles/916c024b775b4858ba18c731196163a6 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:12.582709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f818942-88d1-4a31-b158-03c3defbcb5c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:12.679691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f818942-88d1-4a31-b158-03c3defbcb5c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:12.712790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:12.713349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:12.713631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:12.713906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] PATH_INFO: `/v3/users/4d150ba5d7854e26a167f817e6010827` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:12.715017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] RBAC: Authorizing `identity:get_user(user_id=4d150ba5d7854e26a167f817e6010827)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:12.716488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:12.718034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 572/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:12 2022] GET /identity/v3/users/4d150ba5d7854e26a167f817e6010827 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:12.723734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:12.812641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:12.822170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848127-5451-49ba-afb7-8599566b4694 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:12.853927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc3bb9-8b8e-4fd2-941e-a580e003880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:12.854542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc3bb9-8b8e-4fd2-941e-a580e003880c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:12.854828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc3bb9-8b8e-4fd2-941e-a580e003880c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:12.855107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc3bb9-8b8e-4fd2-941e-a580e003880c None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:12.856233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc3bb9-8b8e-4fd2-941e-a580e003880c None admin] RBAC: Authorizing `identity:get_project(project_id=503c417da8744c7da3014db52bfcf5ba)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:12.857659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc3bb9-8b8e-4fd2-941e-a580e003880c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:12.859262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 550/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:12 2022] GET /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:12.865148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:12.890179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:12.963827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686e03-20b9-4c39-85f3-c09981ce8812 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:12.997566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b08d8d-5e7d-4656-8579-34a1a149619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:12.998213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08d8d-5e7d-4656-8579-34a1a149619e None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:12.998503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08d8d-5e7d-4656-8579-34a1a149619e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:12.998780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08d8d-5e7d-4656-8579-34a1a149619e None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba/users/4d150ba5d7854e26a167f817e6010827/roles/916c024b775b4858ba18c731196163a6` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:13.000924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b08d8d-5e7d-4656-8579-34a1a149619e None admin] RBAC: Authorizing `identity:create_grant(project_id=503c417da8744c7da3014db52bfcf5ba, user_id=4d150ba5d7854e26a167f817e6010827, role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:13.002361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b08d8d-5e7d-4656-8579-34a1a149619e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:13.014582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 573/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:27:12 2022] PUT /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba/users/4d150ba5d7854e26a167f817e6010827/roles/916c024b775b4858ba18c731196163a6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:27:14.916330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf528d-07bc-46e0-82f6-e1435fb68bd2 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:14.916885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf528d-07bc-46e0-82f6-e1435fb68bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:14.916885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf528d-07bc-46e0-82f6-e1435fb68bd2 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:14.918215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 551/1124] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:14.923233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6ee2f-5b38-4b21-99d6-fea5722e0bf7 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:14.923621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6ee2f-5b38-4b21-99d6-fea5722e0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:14.923807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6ee2f-5b38-4b21-99d6-fea5722e0bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:14.941482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-29b6ee2f-5b38-4b21-99d6-fea5722e0bf7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:14.942646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-29b6ee2f-5b38-4b21-99d6-fea5722e0bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:15.008598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 574/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:15.278244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf528d-07bc-46e0-82f6-e1435fb68bd2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:15.376139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf528d-07bc-46e0-82f6-e1435fb68bd2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:15.409247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:15.409861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:15.410142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:15.410416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] PATH_INFO: `/v3/roles/916c024b775b4858ba18c731196163a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:15.411821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] RBAC: Authorizing `identity:get_role(role_id=916c024b775b4858ba18c731196163a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:15.413242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:15.414540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 552/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:15 2022] GET /identity/v3/roles/916c024b775b4858ba18c731196163a6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:15.420183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6ee2f-5b38-4b21-99d6-fea5722e0bf7 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:15.434072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:15.517015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6ee2f-5b38-4b21-99d6-fea5722e0bf7 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:15.549868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:15.550437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:15.550717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:15.550991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] PATH_INFO: `/v3/users/4d150ba5d7854e26a167f817e6010827` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:15.552125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] RBAC: Authorizing `identity:get_user(user_id=4d150ba5d7854e26a167f817e6010827)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:15.554124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:15.555684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 575/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:15 2022] GET /identity/v3/users/4d150ba5d7854e26a167f817e6010827 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:15.561356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:15.590135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:15.660081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb7dc-6981-49f3-b02f-853a4c2897ba None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:15.692398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:15.692988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:15.693270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:15.693545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:15.758473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:15.759922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:15.785798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:15.855231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 553/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:27:15.861010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:15.940829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:15.961362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623ade2-47f7-488b-afab-bc1af0b7a12d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:15.994164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f956f0-e976-4fd3-b317-ec1a2b7969a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:15.994784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f956f0-e976-4fd3-b317-ec1a2b7969a4 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:15.995067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f956f0-e976-4fd3-b317-ec1a2b7969a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:15.995630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f956f0-e976-4fd3-b317-ec1a2b7969a4 None admin] PATH_INFO: `/v3/projects/503c417da8744c7da3014db52bfcf5ba` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:15.996744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f956f0-e976-4fd3-b317-ec1a2b7969a4 None admin] RBAC: Authorizing `identity:get_project(project_id=503c417da8744c7da3014db52bfcf5ba)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:15.998189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f956f0-e976-4fd3-b317-ec1a2b7969a4 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:15.999816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 576/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:15 2022] GET /identity/v3/projects/503c417da8744c7da3014db52bfcf5ba => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:16.006139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:16.102634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547c04b-b218-4a73-b44e-8444b348681c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:16.128441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:16.137317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe618555-0cd5-4a2d-98b8-000f97753149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:16.137922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618555-0cd5-4a2d-98b8-000f97753149 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:16.138202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618555-0cd5-4a2d-98b8-000f97753149 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:16.138477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618555-0cd5-4a2d-98b8-000f97753149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:16.139196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe618555-0cd5-4a2d-98b8-000f97753149 None admin] RBAC: Adding query filter params (role.id=916c024b775b4858ba18c731196163a6, scope.project.id=503c417da8744c7da3014db52bfcf5ba, user.id=4d150ba5d7854e26a167f817e6010827) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:16.139505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe618555-0cd5-4a2d-98b8-000f97753149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:16.140948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe618555-0cd5-4a2d-98b8-000f97753149 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:16.146531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 554/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:16 2022] GET /identity/v3/role_assignments?user.id=4d150ba5d7854e26a167f817e6010827&scope.project.id=503c417da8744c7da3014db52bfcf5ba&role.id=916c024b775b4858ba18c731196163a6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:18.067452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0373-c3d0-4bea-9be4-9f2c76a9f74a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:18.068046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0373-c3d0-4bea-9be4-9f2c76a9f74a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:18.068046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0373-c3d0-4bea-9be4-9f2c76a9f74a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:18.069735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 577/1131] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:18.074908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34169ed-8a02-4d5f-9ee4-94252abad763 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:18.075318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34169ed-8a02-4d5f-9ee4-94252abad763 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:18.075478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34169ed-8a02-4d5f-9ee4-94252abad763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:18.093845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a34169ed-8a02-4d5f-9ee4-94252abad763 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:18.095037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a34169ed-8a02-4d5f-9ee4-94252abad763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:18.161268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 555/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:18.429705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf0373-c3d0-4bea-9be4-9f2c76a9f74a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:18.529881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf0373-c3d0-4bea-9be4-9f2c76a9f74a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:18.562247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766e57-b945-47a8-bb3c-50fa7349c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:18.562865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766e57-b945-47a8-bb3c-50fa7349c129 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:18.563142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766e57-b945-47a8-bb3c-50fa7349c129 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:18.563414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766e57-b945-47a8-bb3c-50fa7349c129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:18.564533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766e57-b945-47a8-bb3c-50fa7349c129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:18.565962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766e57-b945-47a8-bb3c-50fa7349c129 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:18.567477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 578/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:27:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:18.573378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34169ed-8a02-4d5f-9ee4-94252abad763 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:18.669323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34169ed-8a02-4d5f-9ee4-94252abad763 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:18.690798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:18.702392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589f1e4-7505-4555-9edb-5b1026081cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:18.702994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f1e4-7505-4555-9edb-5b1026081cad None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:18.703280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f1e4-7505-4555-9edb-5b1026081cad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:18.703557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f1e4-7505-4555-9edb-5b1026081cad None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:18.704233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589f1e4-7505-4555-9edb-5b1026081cad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:18.705657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589f1e4-7505-4555-9edb-5b1026081cad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:18.732261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 556/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:27:18 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:27:20.653615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae23bd4-a6e7-4f9f-b635-ab3c2d95ca26 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:20.654163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae23bd4-a6e7-4f9f-b635-ab3c2d95ca26 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:20.654163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae23bd4-a6e7-4f9f-b635-ab3c2d95ca26 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:20.655486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 579/1135] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:20.660663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214abeb6-d49d-4989-9b28-3a0159bf9e67 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:20.661039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214abeb6-d49d-4989-9b28-3a0159bf9e67 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:20.661229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214abeb6-d49d-4989-9b28-3a0159bf9e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:20.679011 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-214abeb6-d49d-4989-9b28-3a0159bf9e67 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:20.680215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-214abeb6-d49d-4989-9b28-3a0159bf9e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:20.744652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 557/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:21.017284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae23bd4-a6e7-4f9f-b635-ab3c2d95ca26 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:21.035326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:21.119651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae23bd4-a6e7-4f9f-b635-ab3c2d95ca26 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:21.153493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c71aa5-1958-4d2d-8b70-fca734bef73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:21.154122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71aa5-1958-4d2d-8b70-fca734bef73d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:21.154402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71aa5-1958-4d2d-8b70-fca734bef73d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:21.154674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c71aa5-1958-4d2d-8b70-fca734bef73d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:21.155799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c71aa5-1958-4d2d-8b70-fca734bef73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:21.157238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c71aa5-1958-4d2d-8b70-fca734bef73d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:21.158804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 580/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:21.165025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214abeb6-d49d-4989-9b28-3a0159bf9e67 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:21.267797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214abeb6-d49d-4989-9b28-3a0159bf9e67 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:21.269957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:21.300737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2353d76-21b4-477a-881d-fba9f811d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:21.301334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2353d76-21b4-477a-881d-fba9f811d29b None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:21.301615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2353d76-21b4-477a-881d-fba9f811d29b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:21.301892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2353d76-21b4-477a-881d-fba9f811d29b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:21.302544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2353d76-21b4-477a-881d-fba9f811d29b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:21.304537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2353d76-21b4-477a-881d-fba9f811d29b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:21.325107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 558/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:27:21 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:27:23.256016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b36ef-1b2f-4fa5-94b2-371b4ea3dec2 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:23.256565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b36ef-1b2f-4fa5-94b2-371b4ea3dec2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:23.256565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b36ef-1b2f-4fa5-94b2-371b4ea3dec2 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:23.257876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 581/1139] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:23.263469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882170-c2fc-4f75-8a73-765ecf2ab045 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:23.263918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882170-c2fc-4f75-8a73-765ecf2ab045 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:23.264071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882170-c2fc-4f75-8a73-765ecf2ab045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:23.281755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-27882170-c2fc-4f75-8a73-765ecf2ab045 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:23.282950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27882170-c2fc-4f75-8a73-765ecf2ab045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:23.347784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 559/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:23.618350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b36ef-1b2f-4fa5-94b2-371b4ea3dec2 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:23.701777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:23.718997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b36ef-1b2f-4fa5-94b2-371b4ea3dec2 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:23.751381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:23.752028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:23.752306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:23.752577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:23.762905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:23.767603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:23.768774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:23.770092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 582/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:23.775668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27882170-c2fc-4f75-8a73-765ecf2ab045 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:23.860881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:23.871771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27882170-c2fc-4f75-8a73-765ecf2ab045 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:23.904438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:23.905039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:23.905322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:23.905596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:23.906251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:23.906554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:23.907933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:23.915796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 560/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:23.921599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:24.022228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d6c4-3e4d-4548-9bb0-bf6745cd833f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:24.055845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:24.056487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:24.056769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:24.057044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] PATH_INFO: `/v3/users/d011b9e0456a4f749a218fda449f1b28` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:24.069560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] RBAC: Authorizing `identity:get_user(user_id=d011b9e0456a4f749a218fda449f1b28)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:24.071155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:24.072763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 583/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:23 2022] GET /identity/v3/users/d011b9e0456a4f749a218fda449f1b28 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:24.078552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:24.177507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc28831-18cb-4a52-b770-305edb7f2dc1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:24.210239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:24.211724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:24.212012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:24.212287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:24.232466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:24.277785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:24.279216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:24.373585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 561/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:27:24.379822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:24.383795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:24.479943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc2c3-3369-4c56-a4d9-4b2215d79fca None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:24.513076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62d0d6-c6e5-4653-87bf-23c1833ebcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:24.513697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d0d6-c6e5-4653-87bf-23c1833ebcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:24.513977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d0d6-c6e5-4653-87bf-23c1833ebcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:24.514251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d0d6-c6e5-4653-87bf-23c1833ebcc7 None admin] PATH_INFO: `/v3/projects/87c84e69090d46a1964301b82bf52838` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:24.515351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62d0d6-c6e5-4653-87bf-23c1833ebcc7 None admin] RBAC: Authorizing `identity:get_project(project_id=87c84e69090d46a1964301b82bf52838)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:24.516825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62d0d6-c6e5-4653-87bf-23c1833ebcc7 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:24.518415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 584/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:24 2022] GET /identity/v3/projects/87c84e69090d46a1964301b82bf52838 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:24.525219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:24.577262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:24.622992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620e57-34d3-4ba3-bcbf-6d9b2898e8bd None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:24.655931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682844ad-5f72-445b-a59f-f52e2aba01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:24.656465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682844ad-5f72-445b-a59f-f52e2aba01ce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:24.656749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682844ad-5f72-445b-a59f-f52e2aba01ce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:24.657031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682844ad-5f72-445b-a59f-f52e2aba01ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:24.657749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682844ad-5f72-445b-a59f-f52e2aba01ce None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=87c84e69090d46a1964301b82bf52838, user.id=d011b9e0456a4f749a218fda449f1b28) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:24.658060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682844ad-5f72-445b-a59f-f52e2aba01ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:24.659490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682844ad-5f72-445b-a59f-f52e2aba01ce None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:24.664820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 562/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:24 2022] GET /identity/v3/role_assignments?user.id=d011b9e0456a4f749a218fda449f1b28&scope.project.id=87c84e69090d46a1964301b82bf52838&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:26.538558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac737f-5dd0-4576-b1d1-3b2a06189575 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:26.539095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac737f-5dd0-4576-b1d1-3b2a06189575 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:26.539203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac737f-5dd0-4576-b1d1-3b2a06189575 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:26.540502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 585/1147] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:26.545576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd837-d94f-47d8-a01a-00879cbd68e9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:26.545991 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd837-d94f-47d8-a01a-00879cbd68e9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:26.546159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd837-d94f-47d8-a01a-00879cbd68e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:26.563992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2c4cd837-d94f-47d8-a01a-00879cbd68e9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:26.565171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c4cd837-d94f-47d8-a01a-00879cbd68e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:26.629917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 563/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:26.899356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac737f-5dd0-4576-b1d1-3b2a06189575 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:26.967968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:26.999470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac737f-5dd0-4576-b1d1-3b2a06189575 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:27.032235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:27.032852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:27.033128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:27.033396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:27.043387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:27.048112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:27.049194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:27.050217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 586/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:27.055631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd837-d94f-47d8-a01a-00879cbd68e9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:27.100316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:27.153777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd837-d94f-47d8-a01a-00879cbd68e9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:27.186839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:27.187436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:27.187758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:27.188038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:27.188696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:27.189004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:27.190367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:27.198437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 564/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:27.204468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:27.302239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e96aac-1e69-428d-b0cb-bf132699ee7b None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:27.329996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:27.336616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:27.337228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:27.337508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:27.337783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] PATH_INFO: `/v3/users/d011b9e0456a4f749a218fda449f1b28` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:27.338897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] RBAC: Authorizing `identity:get_user(user_id=d011b9e0456a4f749a218fda449f1b28)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:27.340364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:27.341901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 587/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:27 2022] GET /identity/v3/users/d011b9e0456a4f749a218fda449f1b28 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:27.347608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:27.443459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1a199-a3dc-4ef5-86f1-8f07ccd28310 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:27.452614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:27.477352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba532ca4-17fc-40e8-85c9-e4c87914598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:27.477966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba532ca4-17fc-40e8-85c9-e4c87914598f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:27.478243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba532ca4-17fc-40e8-85c9-e4c87914598f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:27.478513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba532ca4-17fc-40e8-85c9-e4c87914598f None admin] PATH_INFO: `/v3/projects/87c84e69090d46a1964301b82bf52838` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:27.479617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba532ca4-17fc-40e8-85c9-e4c87914598f None admin] RBAC: Authorizing `identity:get_project(project_id=87c84e69090d46a1964301b82bf52838)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:27.481035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba532ca4-17fc-40e8-85c9-e4c87914598f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:27.482628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 565/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:27 2022] GET /identity/v3/projects/87c84e69090d46a1964301b82bf52838 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:27.488450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:27.586078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb430e8c-5153-44f1-bdb9-9d1c55e48a24 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:27.618942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21ffbe-249e-4a81-969d-1adb8d0a2ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:27.619576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ffbe-249e-4a81-969d-1adb8d0a2ad5 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:27.619882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ffbe-249e-4a81-969d-1adb8d0a2ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:27.620414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ffbe-249e-4a81-969d-1adb8d0a2ad5 None admin] PATH_INFO: `/v3/projects/87c84e69090d46a1964301b82bf52838/users/d011b9e0456a4f749a218fda449f1b28/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:27.622270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21ffbe-249e-4a81-969d-1adb8d0a2ad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=87c84e69090d46a1964301b82bf52838, user_id=d011b9e0456a4f749a218fda449f1b28, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:27.623725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21ffbe-249e-4a81-969d-1adb8d0a2ad5 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:27.637103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 588/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:27:27 2022] PUT /identity/v3/projects/87c84e69090d46a1964301b82bf52838/users/d011b9e0456a4f749a218fda449f1b28/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:27:29.511563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc351-1508-4881-88cf-b24cd102fd18 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:29.512099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc351-1508-4881-88cf-b24cd102fd18 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:29.512190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc351-1508-4881-88cf-b24cd102fd18 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:29.513484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 566/1154] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:29.518542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca31522-a542-4f61-83f3-36f21bd06603 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:29.518960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca31522-a542-4f61-83f3-36f21bd06603 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:29.519074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca31522-a542-4f61-83f3-36f21bd06603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:29.537377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-1ca31522-a542-4f61-83f3-36f21bd06603 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:29.538562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1ca31522-a542-4f61-83f3-36f21bd06603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:29.589993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:29.603926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 589/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:29.874846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bc351-1508-4881-88cf-b24cd102fd18 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:29.974083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bc351-1508-4881-88cf-b24cd102fd18 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:30.008719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:30.009339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:30.009619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:30.009893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:30.019640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:30.024736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:30.025845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:27:30.027017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 567/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:30.031668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca31522-a542-4f61-83f3-36f21bd06603 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:30.127067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca31522-a542-4f61-83f3-36f21bd06603 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:30.159792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:30.160390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:30.160670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:30.160941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:30.161593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:30.161891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:30.163900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:30.171776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 590/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:30.178104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:30.212092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:30.275436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0c3ea-fc21-4543-9aad-8702905f9121 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:30.308571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:30.309184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:30.309465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:30.309738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] PATH_INFO: `/v3/users/d011b9e0456a4f749a218fda449f1b28` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:30.310839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=d011b9e0456a4f749a218fda449f1b28)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:30.312417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:30.313975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 568/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:30 2022] GET /identity/v3/users/d011b9e0456a4f749a218fda449f1b28 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:30.319845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:30.369672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:30.418828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60f22-e959-4a5b-a5f0-6bb06551ffd6 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:30.452160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:30.452759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:30.453037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:30.453310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:30.519445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:30.520940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:30.570493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:30.620362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 591/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:27:30.626395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:30.723232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec892-edda-4ac9-90d4-46288f07f0e1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:30.725442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:30.756663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cd392-fdab-489b-95b9-8eaf166ab19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:30.757326 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cd392-fdab-489b-95b9-8eaf166ab19a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:30.757751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cd392-fdab-489b-95b9-8eaf166ab19a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:30.758031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cd392-fdab-489b-95b9-8eaf166ab19a None admin] PATH_INFO: `/v3/projects/87c84e69090d46a1964301b82bf52838` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:30.759137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cd392-fdab-489b-95b9-8eaf166ab19a None admin] RBAC: Authorizing `identity:get_project(project_id=87c84e69090d46a1964301b82bf52838)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:30.760593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cd392-fdab-489b-95b9-8eaf166ab19a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:30.762374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 569/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:30 2022] GET /identity/v3/projects/87c84e69090d46a1964301b82bf52838 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:30.768309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:30.864551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81665ab3-b407-428b-bc80-f551aee3621f None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:30.896854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb50a7-051f-45bd-b2ad-58b31644f9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:30.897446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb50a7-051f-45bd-b2ad-58b31644f9de None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:30.898272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb50a7-051f-45bd-b2ad-58b31644f9de None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:30.898536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb50a7-051f-45bd-b2ad-58b31644f9de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:30.899251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb50a7-051f-45bd-b2ad-58b31644f9de None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=87c84e69090d46a1964301b82bf52838, user.id=d011b9e0456a4f749a218fda449f1b28) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:30.899558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb50a7-051f-45bd-b2ad-58b31644f9de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:30.901016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb50a7-051f-45bd-b2ad-58b31644f9de None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:30.906544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 592/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:30 2022] GET /identity/v3/role_assignments?user.id=d011b9e0456a4f749a218fda449f1b28&scope.project.id=87c84e69090d46a1964301b82bf52838&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:32.836345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fe52-17ec-4d31-ad1d-8c8172b62de5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:32.836877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fe52-17ec-4d31-ad1d-8c8172b62de5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:32.837123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fe52-17ec-4d31-ad1d-8c8172b62de5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:32.838898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 570/1162] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:32.844155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220316-8bd1-4125-b305-2f7b2f4a7cc2 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:32.844548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220316-8bd1-4125-b305-2f7b2f4a7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:32.844706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220316-8bd1-4125-b305-2f7b2f4a7cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:32.863001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-6c220316-8bd1-4125-b305-2f7b2f4a7cc2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:32.864228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6c220316-8bd1-4125-b305-2f7b2f4a7cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:32.873659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:32.931777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 593/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:33.212219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94fe52-17ec-4d31-ad1d-8c8172b62de5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:33.313078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94fe52-17ec-4d31-ad1d-8c8172b62de5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:33.345225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:33.345818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:33.346101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:33.346378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:33.385935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:33.412444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:33.414114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:33.507876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 571/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:27:33.513773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220316-8bd1-4125-b305-2f7b2f4a7cc2 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:33.610189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220316-8bd1-4125-b305-2f7b2f4a7cc2 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:33.644057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656897-5efc-4f8f-ae68-370ca70bc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:33.644622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656897-5efc-4f8f-ae68-370ca70bc3ec None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:33.644905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656897-5efc-4f8f-ae68-370ca70bc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:33.645180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656897-5efc-4f8f-ae68-370ca70bc3ec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:33.651752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656897-5efc-4f8f-ae68-370ca70bc3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:33.653199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656897-5efc-4f8f-ae68-370ca70bc3ec None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-94656897-5efc-4f8f-ae68-370ca70bc3ec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:33.664422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:33.665751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:33.666898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 594/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:27:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:33.671365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:33.738319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:33.768228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34a285-7d7b-4c30-a648-69ad0ab19550 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:33.800275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec8573-c408-459a-9b78-a46da330e602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:33.800863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec8573-c408-459a-9b78-a46da330e602 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:33.801142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec8573-c408-459a-9b78-a46da330e602 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:33.801412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec8573-c408-459a-9b78-a46da330e602 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:33.802038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec8573-c408-459a-9b78-a46da330e602 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:33.802339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec8573-c408-459a-9b78-a46da330e602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:33.804221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec8573-c408-459a-9b78-a46da330e602 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:33.811033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 572/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Sep 5 10:27:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:35.713805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162b058-7da5-4ec3-a734-b12b2de4899f None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:35.714366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162b058-7da5-4ec3-a734-b12b2de4899f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:35.714366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162b058-7da5-4ec3-a734-b12b2de4899f None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:35.715703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 595/1167] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:35.720704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7fd4-faf2-4aa8-b43e-d507bd7dd6e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:35.721104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7fd4-faf2-4aa8-b43e-d507bd7dd6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:35.721251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7fd4-faf2-4aa8-b43e-d507bd7dd6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:35.739489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-23be7fd4-faf2-4aa8-b43e-d507bd7dd6e1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:35.740689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-23be7fd4-faf2-4aa8-b43e-d507bd7dd6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:35.806049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 573/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:36.075615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162b058-7da5-4ec3-a734-b12b2de4899f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:36.079470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:36.176499 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162b058-7da5-4ec3-a734-b12b2de4899f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:36.209003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e6aba-7e9d-4004-94a4-f335739b8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:36.209598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e6aba-7e9d-4004-94a4-f335739b8107 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:36.209980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e6aba-7e9d-4004-94a4-f335739b8107 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:36.210457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e6aba-7e9d-4004-94a4-f335739b8107 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:36.211132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e6aba-7e9d-4004-94a4-f335739b8107 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:36.212538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e6aba-7e9d-4004-94a4-f335739b8107 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:36.228072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 596/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Mon Sep 5 10:27:36 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:27:38.141139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9485-13b0-419c-8c99-7edbdabc287f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:38.141595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9485-13b0-419c-8c99-7edbdabc287f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:38.141687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9485-13b0-419c-8c99-7edbdabc287f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:38.143038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 574/1170] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:38.148220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098da9-2dc3-40e4-9cf8-daec8369a6bd None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:38.148633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098da9-2dc3-40e4-9cf8-daec8369a6bd None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:38.148772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b098da9-2dc3-40e4-9cf8-daec8369a6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:38.167299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2b098da9-2dc3-40e4-9cf8-daec8369a6bd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:38.168513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2b098da9-2dc3-40e4-9cf8-daec8369a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:38.225298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:38.234793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 597/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:38.501380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9485-13b0-419c-8c99-7edbdabc287f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:38.565512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:38.599777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9485-13b0-419c-8c99-7edbdabc287f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:38.634260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b31039-4cd7-4531-856f-bb2fd69683ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:38.634875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b31039-4cd7-4531-856f-bb2fd69683ff None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:38.635154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b31039-4cd7-4531-856f-bb2fd69683ff None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:38.635424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b31039-4cd7-4531-856f-bb2fd69683ff None admin] PATH_INFO: `/v3/domains/3cef311947204b9dbc0bbee3a8f5361f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:38.645528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b31039-4cd7-4531-856f-bb2fd69683ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=3cef311947204b9dbc0bbee3a8f5361f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:38.646964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b31039-4cd7-4531-856f-bb2fd69683ff None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:38.648892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 575/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Sep 5 10:27:38 2022] GET /identity/v3/domains/3cef311947204b9dbc0bbee3a8f5361f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:38.654723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b098da9-2dc3-40e4-9cf8-daec8369a6bd None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:38.752211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b098da9-2dc3-40e4-9cf8-daec8369a6bd None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:38.784949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c44d0-e4a7-45b1-a5e9-0a32f638ac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:38.785540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c44d0-e4a7-45b1-a5e9-0a32f638ac56 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:38.785816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c44d0-e4a7-45b1-a5e9-0a32f638ac56 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:38.786087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c44d0-e4a7-45b1-a5e9-0a32f638ac56 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:38.786739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c44d0-e4a7-45b1-a5e9-0a32f638ac56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:38.789143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c44d0-e4a7-45b1-a5e9-0a32f638ac56 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:38.813999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 598/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:27:38 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:27:40.710842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16658a13-5132-40c0-9f27-2b7c4af7ad3a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:40.711446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16658a13-5132-40c0-9f27-2b7c4af7ad3a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:40.711446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16658a13-5132-40c0-9f27-2b7c4af7ad3a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:40.712744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 576/1174] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:40.717833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768ccc-a4a3-4d7d-b7ce-712a4c83fbfa None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:40.718262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768ccc-a4a3-4d7d-b7ce-712a4c83fbfa None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:40.718392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768ccc-a4a3-4d7d-b7ce-712a4c83fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:40.736206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-95768ccc-a4a3-4d7d-b7ce-712a4c83fbfa None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:40.737378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-95768ccc-a4a3-4d7d-b7ce-712a4c83fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:40.779082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:40.803549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 599/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:41.070148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16658a13-5132-40c0-9f27-2b7c4af7ad3a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:41.169679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16658a13-5132-40c0-9f27-2b7c4af7ad3a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:41.194154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:41.203415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38b95d-a8b5-4675-8c90-f9ee853036c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:41.204072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b95d-a8b5-4675-8c90-f9ee853036c1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:41.204351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b95d-a8b5-4675-8c90-f9ee853036c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:41.204619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b95d-a8b5-4675-8c90-f9ee853036c1 None admin] PATH_INFO: `/v3/domains/3cef311947204b9dbc0bbee3a8f5361f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:41.205735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38b95d-a8b5-4675-8c90-f9ee853036c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3cef311947204b9dbc0bbee3a8f5361f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:41.207458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38b95d-a8b5-4675-8c90-f9ee853036c1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:41.209052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 577/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Sep 5 10:27:41 2022] GET /identity/v3/domains/3cef311947204b9dbc0bbee3a8f5361f => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:41.215776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95768ccc-a4a3-4d7d-b7ce-712a4c83fbfa None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:41.313416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95768ccc-a4a3-4d7d-b7ce-712a4c83fbfa None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:41.346961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d092a9-8a5c-412e-81f6-636a1ea4137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:41.347501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d092a9-8a5c-412e-81f6-636a1ea4137d None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:41.347806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d092a9-8a5c-412e-81f6-636a1ea4137d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:41.348085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d092a9-8a5c-412e-81f6-636a1ea4137d None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:41.348739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d092a9-8a5c-412e-81f6-636a1ea4137d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:41.350894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d092a9-8a5c-412e-81f6-636a1ea4137d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:41.371455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 600/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:27:41 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:27:43.305278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80710c-b936-441e-9003-4f14e0ba37fe None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:43.305824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80710c-b936-441e-9003-4f14e0ba37fe None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:43.305824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80710c-b936-441e-9003-4f14e0ba37fe None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:43.307183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 578/1178] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:43.312347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3944-cb94-450d-be64-d20a701160a9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:43.312781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3944-cb94-450d-be64-d20a701160a9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:43.312909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3944-cb94-450d-be64-d20a701160a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:43.330714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-127e3944-cb94-450d-be64-d20a701160a9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:43.331925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-127e3944-cb94-450d-be64-d20a701160a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:43.357972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:43.399044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 601/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:43.670055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80710c-b936-441e-9003-4f14e0ba37fe None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:43.767379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80710c-b936-441e-9003-4f14e0ba37fe None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:43.799674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:43.800282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:43.800560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:43.800830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:43.810458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:43.815201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:43.816399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:27:43.817337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 579/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:43.822688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3944-cb94-450d-be64-d20a701160a9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:43.919636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3944-cb94-450d-be64-d20a701160a9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:43.952957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:43.953498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:43.953781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:43.954060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:43.954721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:43.955027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:43.956436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:43.964951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 602/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:43.970535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:44.024635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:44.067279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d73538-c8d1-43cd-8788-9f8ceb4722e5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:44.099940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:44.100640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:44.100916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:44.101190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] PATH_INFO: `/v3/users/aea78865dd3d41539be349e19e9506d3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:44.114310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] RBAC: Authorizing `identity:get_user(user_id=aea78865dd3d41539be349e19e9506d3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:44.116292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:44.117859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 580/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:43 2022] GET /identity/v3/users/aea78865dd3d41539be349e19e9506d3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:44.124034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:44.150911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:44.222988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1266-f253-41df-b12c-80060fe59f3d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:44.255755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:44.257066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:44.257465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:44.257687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:44.322174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:44.323640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:44.345931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:44.418781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 603/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:27:44.424657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:44.520357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf49082-2981-4d24-b54d-69725ca69c01 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:44.532754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:44.553485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e401c8c-69b0-4ab7-b776-4ca4c1f56c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:44.554097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e401c8c-69b0-4ab7-b776-4ca4c1f56c73 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:44.554379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e401c8c-69b0-4ab7-b776-4ca4c1f56c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:44.554655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e401c8c-69b0-4ab7-b776-4ca4c1f56c73 None admin] PATH_INFO: `/v3/projects/5bdafb60ac3e4097a5125f83af9606cc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:44.555809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e401c8c-69b0-4ab7-b776-4ca4c1f56c73 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdafb60ac3e4097a5125f83af9606cc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:44.557226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e401c8c-69b0-4ab7-b776-4ca4c1f56c73 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:44.558824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 581/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:44 2022] GET /identity/v3/projects/5bdafb60ac3e4097a5125f83af9606cc => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:44.564774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:44.662337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668893a-257c-429f-b07c-7c5b3dc48fc1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:44.684730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:44.696058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722ba48-14a0-45bd-81e0-67024c7ee83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:44.696646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722ba48-14a0-45bd-81e0-67024c7ee83e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:44.696921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722ba48-14a0-45bd-81e0-67024c7ee83e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:44.697191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722ba48-14a0-45bd-81e0-67024c7ee83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:44.697909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722ba48-14a0-45bd-81e0-67024c7ee83e None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=5bdafb60ac3e4097a5125f83af9606cc, user.id=aea78865dd3d41539be349e19e9506d3) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:44.698214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722ba48-14a0-45bd-81e0-67024c7ee83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:44.699651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722ba48-14a0-45bd-81e0-67024c7ee83e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:44.704810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 604/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:44 2022] GET /identity/v3/role_assignments?user.id=aea78865dd3d41539be349e19e9506d3&scope.project.id=5bdafb60ac3e4097a5125f83af9606cc&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:46.570997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61394e92-af56-4521-8656-cf363f6fea43 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:46.571539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61394e92-af56-4521-8656-cf363f6fea43 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:46.571539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61394e92-af56-4521-8656-cf363f6fea43 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:46.572914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 582/1186] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:46.578207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080ccd-fdf7-430b-ae8c-81a69410007f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:46.578588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080ccd-fdf7-430b-ae8c-81a69410007f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:46.578758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080ccd-fdf7-430b-ae8c-81a69410007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:46.597900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0e080ccd-fdf7-430b-ae8c-81a69410007f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:46.599099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0e080ccd-fdf7-430b-ae8c-81a69410007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:46.665280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 605/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:46.932279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61394e92-af56-4521-8656-cf363f6fea43 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:47.031021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61394e92-af56-4521-8656-cf363f6fea43 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:47.063879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:47.064495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:47.064782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:47.065059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:47.074786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:47.079612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:47.080680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:27:47.081546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 583/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:47.087081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e080ccd-fdf7-430b-ae8c-81a69410007f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:47.184007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e080ccd-fdf7-430b-ae8c-81a69410007f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:47.200638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:47.218016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:47.218622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:47.218908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:47.219187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:47.219880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:47.220189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:47.221572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:47.229480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 606/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:47.235447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:47.277927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:47.333995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50650197-ac4b-4640-b5ab-c6603c60b6f5 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:47.367195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:47.367831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:47.368113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:47.368393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] PATH_INFO: `/v3/users/aea78865dd3d41539be349e19e9506d3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:47.369493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] RBAC: Authorizing `identity:get_user(user_id=aea78865dd3d41539be349e19e9506d3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:47.371174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:47.372764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 584/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:47 2022] GET /identity/v3/users/aea78865dd3d41539be349e19e9506d3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:47.378661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:47.478125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d273-322c-463f-bec7-850b36dd0d43 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:47.511076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7742342-772f-42a8-a01c-1c162fc842c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:47.511720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7742342-772f-42a8-a01c-1c162fc842c8 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:47.512002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7742342-772f-42a8-a01c-1c162fc842c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:47.512274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7742342-772f-42a8-a01c-1c162fc842c8 None admin] PATH_INFO: `/v3/projects/5bdafb60ac3e4097a5125f83af9606cc` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:47.513376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7742342-772f-42a8-a01c-1c162fc842c8 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdafb60ac3e4097a5125f83af9606cc)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:47.514808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7742342-772f-42a8-a01c-1c162fc842c8 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:47.516417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 607/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:47 2022] GET /identity/v3/projects/5bdafb60ac3e4097a5125f83af9606cc => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:47.522255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:47.618381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a2b2d-d14b-4160-9a55-4ed56d71c982 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:47.627071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:47.652086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255d48-f9fc-4e78-a690-a759419c08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:47.652737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255d48-f9fc-4e78-a690-a759419c08ad None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:47.653023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255d48-f9fc-4e78-a690-a759419c08ad None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:47.653300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255d48-f9fc-4e78-a690-a759419c08ad None admin] PATH_INFO: `/v3/projects/5bdafb60ac3e4097a5125f83af9606cc/users/aea78865dd3d41539be349e19e9506d3/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:47.655158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255d48-f9fc-4e78-a690-a759419c08ad None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdafb60ac3e4097a5125f83af9606cc, user_id=aea78865dd3d41539be349e19e9506d3, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:47.656606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255d48-f9fc-4e78-a690-a759419c08ad None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:47.669306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 585/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:27:47 2022] PUT /identity/v3/projects/5bdafb60ac3e4097a5125f83af9606cc/users/aea78865dd3d41539be349e19e9506d3/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:27:49.541718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e1ac-0087-4dbc-ad66-2e7c960610bc None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:49.542259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e1ac-0087-4dbc-ad66-2e7c960610bc None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:49.542259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e1ac-0087-4dbc-ad66-2e7c960610bc None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:49.543625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 608/1193] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:27:49.548945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d7b3-22b4-4db7-93c1-25953b0bea99 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:49.549360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d7b3-22b4-4db7-93c1-25953b0bea99 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:49.549503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d7b3-22b4-4db7-93c1-25953b0bea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:49.567787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cc09d7b3-22b4-4db7-93c1-25953b0bea99 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:27:49.569539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc09d7b3-22b4-4db7-93c1-25953b0bea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:27:49.634214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 586/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:27:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:27:49.904620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20e1ac-0087-4dbc-ad66-2e7c960610bc None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:49.954328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:50.005334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20e1ac-0087-4dbc-ad66-2e7c960610bc None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:50.038278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:50.038877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:50.039154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:50.039426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:50.049173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:27:50.053949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:27:50.055051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:27:50.056112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 609/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:27:50.060947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d7b3-22b4-4db7-93c1-25953b0bea99 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:50.154309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:50.158134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d7b3-22b4-4db7-93c1-25953b0bea99 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:50.192854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:50.193486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:50.193778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:50.194052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:50.194718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:50.195026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:50.196432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:50.204305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 587/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:27:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:50.210709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:50.309402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a765-8763-47e3-b45f-352a06564ae0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:50.318493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:50.343536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:50.344174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:50.344450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:50.344716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] PATH_INFO: `/v3/users/aea78865dd3d41539be349e19e9506d3` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:50.345818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] RBAC: Authorizing `identity:get_user(user_id=aea78865dd3d41539be349e19e9506d3)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:50.347237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:50.348793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 610/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Sep 5 10:27:50 2022] GET /identity/v3/users/aea78865dd3d41539be349e19e9506d3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:27:50.355121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:50.452402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc4c17-c9c4-4e4e-860d-02b851bef458 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:50.484721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:50.485319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:50.485601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:50.485877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:50.512666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:50.551788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:50.555240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:50.650521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 588/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:27:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:27:50.656457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:50.767195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66b58-5308-4cc8-9cb4-b8a021104f1a None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:50.806363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39825607-aa56-4ab7-bc6d-93a9466aed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:50.806991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825607-aa56-4ab7-bc6d-93a9466aed33 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:50.807429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825607-aa56-4ab7-bc6d-93a9466aed33 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:50.807948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39825607-aa56-4ab7-bc6d-93a9466aed33 None admin] PATH_INFO: `/v3/projects/5bdafb60ac3e4097a5125f83af9606cc` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:50.809600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39825607-aa56-4ab7-bc6d-93a9466aed33 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdafb60ac3e4097a5125f83af9606cc)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:50.811074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39825607-aa56-4ab7-bc6d-93a9466aed33 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:50.812726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 611/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Sep 5 10:27:50 2022] GET /identity/v3/projects/5bdafb60ac3e4097a5125f83af9606cc => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:27:50.819451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:27:50.878263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:27:50.920155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb15c-c1f0-4f4b-abd3-103a4352d40a None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:27:50.953670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b023d-5b44-4902-94b5-6ac08a5de954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:27:50.954276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b023d-5b44-4902-94b5-6ac08a5de954 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:27:50.954555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b023d-5b44-4902-94b5-6ac08a5de954 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:27:50.954826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b023d-5b44-4902-94b5-6ac08a5de954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:27:50.955547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b023d-5b44-4902-94b5-6ac08a5de954 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=5bdafb60ac3e4097a5125f83af9606cc, user.id=aea78865dd3d41539be349e19e9506d3) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:27:50.955887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b023d-5b44-4902-94b5-6ac08a5de954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:27:50.957309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b023d-5b44-4902-94b5-6ac08a5de954 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:27:50.963900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 589/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:27:50 2022] GET /identity/v3/role_assignments?user.id=aea78865dd3d41539be349e19e9506d3&scope.project.id=5bdafb60ac3e4097a5125f83af9606cc&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:00.801363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=78 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:00.961266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=38 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:46.532250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5300-1e87-450c-8a17-050bc9e8725d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:46.532886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5300-1e87-450c-8a17-050bc9e8725d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:46.532886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee5300-1e87-450c-8a17-050bc9e8725d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:46.534961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 612/1201] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:28:46.541197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f59333-c050-4cf6-b429-fb86b22dcfc8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:46.541702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f59333-c050-4cf6-b429-fb86b22dcfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:46.541798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f59333-c050-4cf6-b429-fb86b22dcfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:46.562414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c5f59333-c050-4cf6-b429-fb86b22dcfc8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:28:46.563634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5f59333-c050-4cf6-b429-fb86b22dcfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:28:46.648431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 590/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:28:46.945678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee5300-1e87-450c-8a17-050bc9e8725d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:47.079390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee5300-1e87-450c-8a17-050bc9e8725d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:47.128408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:47.129290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:47.129610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:47.129980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:47.143024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:47.145439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:28:47.163637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:47.164792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:28:47.165805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:28:47.165805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:47.165805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:28:47.167778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 613/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:28:47.171344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f59333-c050-4cf6-b429-fb86b22dcfc8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:47.312504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f59333-c050-4cf6-b429-fb86b22dcfc8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:47.349648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:47.357135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a084a-c8c2-44b1-9190-03d3be0742d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:47.357877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a084a-c8c2-44b1-9190-03d3be0742d2 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:47.358304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a084a-c8c2-44b1-9190-03d3be0742d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:47.358677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a084a-c8c2-44b1-9190-03d3be0742d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:47.359542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a084a-c8c2-44b1-9190-03d3be0742d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:47.359934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a084a-c8c2-44b1-9190-03d3be0742d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:47.361504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a084a-c8c2-44b1-9190-03d3be0742d2 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:47.384290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 591/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:47.385551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:47.460597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:47.534923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307535-8b14-4036-9505-3bfe4dd8a732 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:47.579659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e15f6-f07b-4984-a00d-bafd28efbc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:47.580233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e15f6-f07b-4984-a00d-bafd28efbc2c None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:47.580630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e15f6-f07b-4984-a00d-bafd28efbc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:47.582880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e15f6-f07b-4984-a00d-bafd28efbc2c None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:47.582880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e15f6-f07b-4984-a00d-bafd28efbc2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:47.584316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e15f6-f07b-4984-a00d-bafd28efbc2c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:47.613067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 614/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Sep 5 10:28:47 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:28:49.879909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5645-a123-4450-b46a-7bfcf3cc66bc None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:49.880463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5645-a123-4450-b46a-7bfcf3cc66bc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:49.880747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a5645-a123-4450-b46a-7bfcf3cc66bc None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:49.882394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 592/1206] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:28:49.888314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ed4c-1954-48e7-ab89-bdd0278dfe39 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:49.889111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ed4c-1954-48e7-ab89-bdd0278dfe39 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:49.889111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ed4c-1954-48e7-ab89-bdd0278dfe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:49.911221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0095ed4c-1954-48e7-ab89-bdd0278dfe39 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:28:49.912879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0095ed4c-1954-48e7-ab89-bdd0278dfe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:28:49.991563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 615/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:28:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:28:50.270846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a5645-a123-4450-b46a-7bfcf3cc66bc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:50.395527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a5645-a123-4450-b46a-7bfcf3cc66bc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:50.438935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:50.439578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:50.439899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:50.440184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:50.453536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:28:50.460773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:50.462993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:50.464006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 593/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:28:50.471283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ed4c-1954-48e7-ab89-bdd0278dfe39 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:50.522703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:50.597169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ed4c-1954-48e7-ab89-bdd0278dfe39 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:50.636318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:50.637324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:50.637710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:50.637923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:50.638678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:50.638975 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:50.640692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:50.651013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 616/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:50.659493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:50.720270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:50.782108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49021b45-fda0-4f0b-9389-5f1e5d8ea70f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:50.822788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:50.823518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:50.823749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:50.824023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:50.835801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:50.837259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:28:50.853393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:50.854393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:28:50.855321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:28:50.855321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:50.855321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:50.855321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 594/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:28:50.860588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:50.974139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:50.977733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a881-ba0d-4f7e-84d3-f302d94bba8e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:51.023380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:51.024024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:51.024352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:51.024607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:51.025522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:51.025824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:51.027347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:51.043927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 617/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:51.050089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:51.168386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b926-c696-4fb6-8a37-e3cfb1115954 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:51.170112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:51.220793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:51.222279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:51.222802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:51.223174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:51.231057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:51.232620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:28:51.246305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:51.252198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:51.253233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 595/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:28:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:28:51.253870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:51.373889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f126dc-13ae-4366-87d0-309f38714e5e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:51.414239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:51.414795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:51.415070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:51.415341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:51.416117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:51.416428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:51.417863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:51.439320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 618/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Sep 5 10:28:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:28:51.444413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:51.573758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ae6b0-63c8-4171-9bd7-51265a2d699c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:51.619480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:51.620145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:51.620425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:51.620698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:51.658213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:51.704561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:51.706495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:51.812554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 596/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:28:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:28:51.818906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:51.839515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:51.931931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a32e-5de9-4ab6-a84a-f32927d05aa3 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:51.968547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:51.969306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:51.969529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:51.969774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:51.981439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:51.982928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:28:51.999019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:52.000297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:28:52.001417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:28:52.001417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:52.001417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:28:52.001417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 619/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:28:52.007612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:52.073870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:52.116577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bfc30-032c-4caf-a101-af5e2cac15ac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:52.152218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:52.152790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:52.153125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:52.153352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:52.154001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:52.154309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:52.155728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:52.168644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 597/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:28:52.174298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:52.248011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:52.282499 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56cb9-ef5e-4a6d-986c-2574316e55f1 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:52.319223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:52.319896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:52.320180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:52.320498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:52.327716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:52.329441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:28:52.340998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:52.341985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:28:52.342980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 620/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:28:52.348292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:52.460556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61476b-783f-470d-a15d-8edac42ce30e None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:52.488030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:52.500668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515400e-8173-4d86-994a-14fa5ce848b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:52.501211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515400e-8173-4d86-994a-14fa5ce848b0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:52.501499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515400e-8173-4d86-994a-14fa5ce848b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:52.501777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515400e-8173-4d86-994a-14fa5ce848b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:52.502479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515400e-8173-4d86-994a-14fa5ce848b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:52.502814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515400e-8173-4d86-994a-14fa5ce848b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:52.504454 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515400e-8173-4d86-994a-14fa5ce848b0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:52.522242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 598/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:52.523541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:52.638300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6630a-5f4b-4d84-8907-f77fe0604022 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:52.669758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:52.676866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21373c1d-b64d-4d7d-947e-215bfda6c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:52.677480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373c1d-b64d-4d7d-947e-215bfda6c70c None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:52.678728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373c1d-b64d-4d7d-947e-215bfda6c70c None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:52.678728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373c1d-b64d-4d7d-947e-215bfda6c70c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:52.679085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373c1d-b64d-4d7d-947e-215bfda6c70c None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=9f1f8f4eb1c444edb1c197db41cd6f96) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:52.679421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373c1d-b64d-4d7d-947e-215bfda6c70c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:52.680953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373c1d-b64d-4d7d-947e-215bfda6c70c None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:52.687322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 621/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:28:52 2022] GET /identity/v3/role_assignments?user.id=9f1f8f4eb1c444edb1c197db41cd6f96&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:54.850758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247064a-0030-4aa7-a4db-6ef1f2f70d1a None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:54.851290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247064a-0030-4aa7-a4db-6ef1f2f70d1a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:54.851411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247064a-0030-4aa7-a4db-6ef1f2f70d1a None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:54.852742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 599/1220] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:28:54.858160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ac1f-1ab8-486f-a003-6ae712c3351b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:54.858567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ac1f-1ab8-486f-a003-6ae712c3351b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:54.858716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760ac1f-1ab8-486f-a003-6ae712c3351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:54.879496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0760ac1f-1ab8-486f-a003-6ae712c3351b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:28:54.880749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0760ac1f-1ab8-486f-a003-6ae712c3351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:28:54.950654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 622/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:28:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:28:55.225897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247064a-0030-4aa7-a4db-6ef1f2f70d1a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:55.341321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247064a-0030-4aa7-a4db-6ef1f2f70d1a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:55.378786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:55.379342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:55.379701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:55.379988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:55.391419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:28:55.397136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:55.398229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:55.399104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 600/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:28:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:28:55.404237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760ac1f-1ab8-486f-a003-6ae712c3351b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:55.516124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760ac1f-1ab8-486f-a003-6ae712c3351b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:55.540102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:55.552945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:55.553553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:55.553831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:55.554104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:55.554765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:55.555067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:55.556465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:55.569948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 623/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:28:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:55.571127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:55.617661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:55.680326 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071571c-526a-45c4-a96d-96e2980561f6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:55.715007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:55.715673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:55.716002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:55.716334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:55.728276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:55.729995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:28:55.751283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:55.752511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:28:55.758665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:28:55.758665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:55.758665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:55.758665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 601/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:28:55.759506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:55.878570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865210-7a0a-4de3-9581-93a98a959d12 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:55.916721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:55.917475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:55.917813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:55.918133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:55.918845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:55.919180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:55.920737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:55.935490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 624/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:55.941953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:56.049778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:56.057045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23dbe0-eabf-4cc4-8e2e-f121b4268de9 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:56.092884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:56.093597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:56.093886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:56.094208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:56.103257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:56.104762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:28:56.116512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:56.117577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:56.118583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 602/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:28:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:28:56.124563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:56.176234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:56.237883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23038e-fc4d-42ac-b7bd-b08aab1a1105 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:56.277657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:56.278266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:56.278542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:56.278828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:56.279619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:56.279955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:56.281439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:56.303173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 625/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Sep 5 10:28:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:56.308980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:56.415963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67677edf-21f4-4527-9e13-6e217eea2470 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:56.449980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:56.450616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:56.450903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:56.451184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:56.463088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:56.464584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:28:56.481551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:56.482859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:28:56.484125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:28:56.484125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:28:56.484125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:56.485813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 603/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:28:56.492587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:56.595847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ce11-6a28-4cad-a81f-7d66b5d6b33d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:56.598546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:56.631418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:56.632031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:56.632315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:56.632614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:56.633277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:56.633536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:56.634918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:56.647085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 626/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:28:56.653269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:56.666221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:56.777190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e7135-8763-41e0-b100-b22ee1854aac None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:56.815849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:56.816591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:56.816877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:56.817151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:56.824360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:56.825807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:28:56.838536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:56.839452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:28:56.841023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 604/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 10:28:56.845728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:56.959498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bde01-5604-4042-8f13-d947e733284e None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:57.001875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705cf9f-0ff9-4fb6-9862-6087275367f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:57.003176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705cf9f-0ff9-4fb6-9862-6087275367f1 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:57.003623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705cf9f-0ff9-4fb6-9862-6087275367f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:57.003919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705cf9f-0ff9-4fb6-9862-6087275367f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:57.004644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705cf9f-0ff9-4fb6-9862-6087275367f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:28:57.005000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705cf9f-0ff9-4fb6-9862-6087275367f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:57.006739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705cf9f-0ff9-4fb6-9862-6087275367f1 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:57.024721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 627/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:28:57.026098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:57.094846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:57.131440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d9060-e67c-416c-b838-6273d3480f96 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:57.171071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8f081-1399-4f59-98d6-0c51f21b12c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:57.171860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f081-1399-4f59-98d6-0c51f21b12c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:57.172223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f081-1399-4f59-98d6-0c51f21b12c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:57.172525 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f081-1399-4f59-98d6-0c51f21b12c3 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/9f1f8f4eb1c444edb1c197db41cd6f96/roles/c1bfa1f1c0a34c94b82d6269e57d15e5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:57.189160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f081-1399-4f59-98d6-0c51f21b12c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=9f1f8f4eb1c444edb1c197db41cd6f96, role_id=c1bfa1f1c0a34c94b82d6269e57d15e5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:28:57.190904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8f081-1399-4f59-98d6-0c51f21b12c3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:28:57.203392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 605/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:28:57 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/9f1f8f4eb1c444edb1c197db41cd6f96/roles/c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:28:59.301317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9967c-1c30-4409-9e79-13615680d219 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:59.301881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9967c-1c30-4409-9e79-13615680d219 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:59.302081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9967c-1c30-4409-9e79-13615680d219 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:59.303537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 628/1233] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:28:59.309876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383df2-4464-418f-ab89-6f58d290b03c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:59.310269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383df2-4464-418f-ab89-6f58d290b03c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:59.310423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383df2-4464-418f-ab89-6f58d290b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:59.331602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b8383df2-4464-418f-ab89-6f58d290b03c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:28:59.333112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b8383df2-4464-418f-ab89-6f58d290b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:28:59.412626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 606/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:28:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:28:59.745542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9967c-1c30-4409-9e79-13615680d219 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:59.773738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:28:59.862616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9967c-1c30-4409-9e79-13615680d219 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:28:59.907920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:28:59.908679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:28:59.909459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:28:59.909857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:28:59.922316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:28:59.928037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:28:59.929177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:28:59.930084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 629/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Sep 5 10:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:28:59.936235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383df2-4464-418f-ab89-6f58d290b03c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:28:59.986257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:00.047450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383df2-4464-418f-ab89-6f58d290b03c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:00.091461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:00.092276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:00.092550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:00.092940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:00.093836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] RBAC: Adding query filter params (name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:00.094142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:00.096033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:00.106875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 607/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Sep 5 10:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:00.113586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:00.215204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:00.233310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbcba8-79b9-4c04-a056-45fb1e919170 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:00.273893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:00.274942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:00.274942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:00.275256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:00.288107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:00.289615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:00.306956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:00.308596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:00.309502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:00.309502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:00.309502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:00.309502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 630/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:00.316215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:00.420618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567582-323a-41a9-8357-c63ff997089c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:00.432709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:00.460343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:00.460964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:00.461252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:00.461535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:00.462267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:00.462590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:00.464160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:00.479920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 608/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:29:00.487302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:00.605741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7d0f-2618-4640-bcf2-12482b65d827 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:00.646304 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:00.647072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:00.647371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:00.647768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:00.651343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:00.658062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:00.660249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:29:00.672560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:00.673748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:00.675168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 631/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:00.680045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:00.800602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa108-6af0-439d-9927-5a0eed7f6c55 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:00.838932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:00.839562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:00.839882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:00.840163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:00.840917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:00.841244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:00.842702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:00.862948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 609/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Sep 5 10:29:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:00.868960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:00.984287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cd218-28e5-49b0-9ee5-154a5915b598 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:01.020731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:01.021466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:01.021960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:01.022239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:01.092353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:01.100015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:01.101763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:01.209984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 632/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:29:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 10:29:01.216141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:01.249844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:01.337638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929881f7-687e-46d3-9dca-1e960ddc0878 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:01.373542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:01.374177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:01.374465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:01.374796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:01.387075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:01.388686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:01.408108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:01.409979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:01.410999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:01.410999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:01.410999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:01.410999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 610/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:01.415553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:01.525666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:01.532735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3561f-f9c6-4573-b523-7a735f959be0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:01.572686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:01.573268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:01.573546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:01.573820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:01.574500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:01.574806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:01.576226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:01.588094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 633/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:01.593778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:01.680689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:01.704933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b6c14-6f32-4bf3-8c1f-94c942661979 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:01.742482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:01.743197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:01.743503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:01.744086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:01.751156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:01.752752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:29:01.764247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:01.765333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:01.766321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 611/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:01.771462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:01.879323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661040c-dab9-4b87-b7b7-5022785e37fd None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:01.917212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c9102-c0f8-4c71-bab1-6e070bb20f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:01.917872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9102-c0f8-4c71-bab1-6e070bb20f3e None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:01.918139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9102-c0f8-4c71-bab1-6e070bb20f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:01.918416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9102-c0f8-4c71-bab1-6e070bb20f3e None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:01.919122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c9102-c0f8-4c71-bab1-6e070bb20f3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:01.919426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c9102-c0f8-4c71-bab1-6e070bb20f3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:01.920909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c9102-c0f8-4c71-bab1-6e070bb20f3e None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:01.933941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 634/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:01.940086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:02.054596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe6896-c47d-4039-9bf7-072f92a45209 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:02.092359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426912-9652-4ea5-8f32-c7caaf1e4ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:02.093057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426912-9652-4ea5-8f32-c7caaf1e4ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:02.093348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426912-9652-4ea5-8f32-c7caaf1e4ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:02.093627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426912-9652-4ea5-8f32-c7caaf1e4ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:02.094424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426912-9652-4ea5-8f32-c7caaf1e4ca0 None admin] RBAC: Adding query filter params (role.id=c1bfa1f1c0a34c94b82d6269e57d15e5, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=9f1f8f4eb1c444edb1c197db41cd6f96) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:02.094782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426912-9652-4ea5-8f32-c7caaf1e4ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:02.096468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426912-9652-4ea5-8f32-c7caaf1e4ca0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:02.102903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 612/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:29:01 2022] GET /identity/v3/role_assignments?user.id=9f1f8f4eb1c444edb1c197db41cd6f96&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=c1bfa1f1c0a34c94b82d6269e57d15e5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:04.346264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3cc5d-b0ca-4e13-8ae0-5fe3476d63aa None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:04.346887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3cc5d-b0ca-4e13-8ae0-5fe3476d63aa None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:04.347118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3cc5d-b0ca-4e13-8ae0-5fe3476d63aa None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:04.348584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 635/1247] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:29:04.354352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2466c-f471-4e86-8b77-885e6398054c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:04.354833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2466c-f471-4e86-8b77-885e6398054c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:04.354915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2466c-f471-4e86-8b77-885e6398054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:04.363542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:04.380499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cce2466c-f471-4e86-8b77-885e6398054c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:29:04.382114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cce2466c-f471-4e86-8b77-885e6398054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:29:04.467680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 613/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:29:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:29:04.798573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3cc5d-b0ca-4e13-8ae0-5fe3476d63aa None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:04.824542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:04.916846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3cc5d-b0ca-4e13-8ae0-5fe3476d63aa None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:04.950083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:04.950705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:04.950989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:04.951258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:04.962546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:29:04.968163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:04.969391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:04.970467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 636/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:04.977774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2466c-f471-4e86-8b77-885e6398054c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:05.090677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2466c-f471-4e86-8b77-885e6398054c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:05.127744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:05.133614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:05.134281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:05.134700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:05.134998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:05.135722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:05.136039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:05.137685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:05.146921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 614/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:05.153163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:05.244343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:05.272010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad210e-999a-4cc2-856c-19b3424e674d None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:05.309605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:05.310246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:05.310534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:05.310809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:05.323803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:05.326127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:05.343996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:05.345155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:05.346888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:05.346888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:05.346888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:05.346888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 637/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:05.353080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:05.459917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b8e4-89fd-45b3-99bd-8efc34f49b20 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:05.500042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:05.500799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:05.501238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:05.501510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:05.502280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:05.502636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:05.504425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:05.522561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 615/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:29:05.523794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:05.635402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2aba-70c8-4326-941e-9b2da48a1966 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:05.662261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:05.671709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:05.672450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:05.672732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:05.673056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:05.682543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:05.684120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:29:05.697099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:05.698440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:05.699414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 638/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:05.704517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:05.764748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:05.819022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7f3c-d336-4c35-8613-73fed8f8b82b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:05.856429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:05.857037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:05.857319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:05.857592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:05.858328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:05.858632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:05.860098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:05.884984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 616/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Sep 5 10:29:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:05.886204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:05.995219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3aee0-e499-4d4f-9aa0-d55fa2bf3de0 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:06.031579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:06.032270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:06.032500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:06.032788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:06.095282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:06.109531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:06.111065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:06.226039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 639/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:29:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:29:06.231971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:06.347841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173daa-1c3a-4a8c-878c-697f310bf284 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:06.362885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:06.387780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:06.388425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:06.388725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:06.388976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:06.400372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:06.401874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:06.418272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:06.419572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:06.420737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:06.420737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:06.420737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:06.424052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 617/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:06.425735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:06.528962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:06.542274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c906-cf2b-4a94-9104-d9b8969402bf None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:06.579775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:06.580438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:06.580724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:06.581031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:06.581763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:06.582073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:06.583481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:06.596122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 640/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:29:06.602131 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:06.712018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14529b-d9ec-44b8-9de1-93f198794e69 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:06.747964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:06.748622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:06.748906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:06.749181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:06.757248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:06.758715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:29:06.770609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:06.771611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:06.772528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:06.775756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 618/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:06.778004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:06.881900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89af49-e5e0-4dd6-857b-0b920ed48793 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:06.916339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92834034-3038-479a-b996-1b450873ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:06.916956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834034-3038-479a-b996-1b450873ce8f None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:06.917239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834034-3038-479a-b996-1b450873ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:06.917515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834034-3038-479a-b996-1b450873ce8f None admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:06.918249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92834034-3038-479a-b996-1b450873ce8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:06.918558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92834034-3038-479a-b996-1b450873ce8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:06.920040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92834034-3038-479a-b996-1b450873ce8f None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:06.932264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 641/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:06.938644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:06.966020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:07.044155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478b2a6-eb4a-4455-8943-44d71d4bfbb3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:07.077646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63401220-f5dd-4283-a8c8-33df91b4001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:07.078271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401220-f5dd-4283-a8c8-33df91b4001a None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:07.078552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401220-f5dd-4283-a8c8-33df91b4001a None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:07.078826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401220-f5dd-4283-a8c8-33df91b4001a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:07.079547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401220-f5dd-4283-a8c8-33df91b4001a None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=9f1f8f4eb1c444edb1c197db41cd6f96) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:07.080579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401220-f5dd-4283-a8c8-33df91b4001a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:07.082115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401220-f5dd-4283-a8c8-33df91b4001a None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:07.087408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 619/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:29:06 2022] GET /identity/v3/role_assignments?user.id=9f1f8f4eb1c444edb1c197db41cd6f96&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:08.960496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08284d42-7a2e-4876-963f-557fcbaeb600 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:08.961027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08284d42-7a2e-4876-963f-557fcbaeb600 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:08.961027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08284d42-7a2e-4876-963f-557fcbaeb600 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:08.962408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 642/1261] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:29:08.967359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4029a-e24c-46b6-92a3-bb4bc54ca272 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:08.967747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4029a-e24c-46b6-92a3-bb4bc54ca272 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:08.967953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4029a-e24c-46b6-92a3-bb4bc54ca272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:08.985904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f0e4029a-e24c-46b6-92a3-bb4bc54ca272 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:29:08.987761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f0e4029a-e24c-46b6-92a3-bb4bc54ca272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:29:09.053265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 620/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:29:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:29:09.326995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08284d42-7a2e-4876-963f-557fcbaeb600 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:09.338104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:09.428350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08284d42-7a2e-4876-963f-557fcbaeb600 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:09.462648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:09.463330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:09.463692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:09.464008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:09.476549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:29:09.482220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:09.483387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:09.484348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 643/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:09.491173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4029a-e24c-46b6-92a3-bb4bc54ca272 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:09.514971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:09.598962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4029a-e24c-46b6-92a3-bb4bc54ca272 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:09.631384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:09.632028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:09.632309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:09.632583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:09.633239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:09.633542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:09.634901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:09.643386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 621/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:29:09.649198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:09.714551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:09.747065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2773591-05d0-41e0-aa34-4768365eaa00 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:09.780107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:09.780727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:09.781007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:09.781282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:09.791572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:09.793048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:09.807365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:09.808552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:09.809831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:09.809831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:09.809831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:09.809831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 644/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:09.814350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:09.893962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:09.912744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbdc9d-28a1-4132-8029-9bcd47a69ae1 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:09.945109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:09.945703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:09.945986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:09.946260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:09.946894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:09.947196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:09.948585 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:09.960493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 622/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:09.966163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:10.063463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc602fd7-8d82-4977-abcb-5eb65860e682 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:10.084055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:10.098770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:10.099394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:10.099712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:10.099993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:10.107449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:10.108933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:29:10.120158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:10.121247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:10.122372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 645/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:10.127479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:10.224415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7edae-34a7-493d-ba06-81b63a6c9d5b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:10.257964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:10.258554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:10.258838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:10.259111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:10.259855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:10.260165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:10.261580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:10.270538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:10.278884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 623/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Sep 5 10:29:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:10.285141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:10.382430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1e4f9-6adf-443a-818f-f88aec026a34 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:10.415966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:10.416583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:10.416863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:10.417138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:10.427352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:10.428850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:10.442631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:10.443801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:10.444739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:10.444739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:10.444739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:10.444739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 646/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:10.449673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:10.554943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa004d-4533-4e1c-9ab7-9c45abb25c0b None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:10.587225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:10.587844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:10.588127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:10.588400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:10.589031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:10.589331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:10.590677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:10.602014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 624/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:10.607686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:10.639695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:10.708132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ad62-246c-40d2-91e2-73a17db71184 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:10.740363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:10.740970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:10.741245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:10.741514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:10.748515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:10.749963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:29:10.761552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:10.762586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:10.763644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 647/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:10.769152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:10.824741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:10.866206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d8ff-423b-4332-bda5-36bef103d332 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:10.899520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a238aa3-cb96-483b-8f10-f53b1ce70e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:10.900136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a238aa3-cb96-483b-8f10-f53b1ce70e7b None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:10.900416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a238aa3-cb96-483b-8f10-f53b1ce70e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:10.900686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a238aa3-cb96-483b-8f10-f53b1ce70e7b None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:10.901360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a238aa3-cb96-483b-8f10-f53b1ce70e7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:10.901663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a238aa3-cb96-483b-8f10-f53b1ce70e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:10.903070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a238aa3-cb96-483b-8f10-f53b1ce70e7b None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:10.914590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 625/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:10.920577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:11.011345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:11.020972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034138f5-f2ba-4d4e-ac82-ad55f047ef50 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:11.053895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4dbe4-e285-4105-b469-924a8efa29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:11.054539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dbe4-e285-4105-b469-924a8efa29a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:11.054821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dbe4-e285-4105-b469-924a8efa29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:11.055094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dbe4-e285-4105-b469-924a8efa29a0 None admin] PATH_INFO: `/v3/projects/f670453166984725b3361f82ce283c4b/users/9f1f8f4eb1c444edb1c197db41cd6f96/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:11.056978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4dbe4-e285-4105-b469-924a8efa29a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f670453166984725b3361f82ce283c4b, user_id=9f1f8f4eb1c444edb1c197db41cd6f96, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:11.058415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4dbe4-e285-4105-b469-924a8efa29a0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:11.071117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 648/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Sep 5 10:29:10 2022] PUT /identity/v3/projects/f670453166984725b3361f82ce283c4b/users/9f1f8f4eb1c444edb1c197db41cd6f96/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:29:12.943960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcbb7e-6da9-402c-bfff-daa51bbd5687 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:12.944552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcbb7e-6da9-402c-bfff-daa51bbd5687 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:12.944552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcbb7e-6da9-402c-bfff-daa51bbd5687 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:12.945830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 626/1274] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:29:12.950831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cf07-1fa4-4b3d-9a72-518bdf2eb355 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:12.951217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cf07-1fa4-4b3d-9a72-518bdf2eb355 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:12.951392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cf07-1fa4-4b3d-9a72-518bdf2eb355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:12.969844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e5a4cf07-1fa4-4b3d-9a72-518bdf2eb355 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:29:12.971172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e5a4cf07-1fa4-4b3d-9a72-518bdf2eb355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:29:13.036680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 649/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:29:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:29:13.305699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcbb7e-6da9-402c-bfff-daa51bbd5687 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:13.407943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcbb7e-6da9-402c-bfff-daa51bbd5687 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:13.424911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:13.441349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:13.441967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:13.442247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:13.442521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:13.453233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 10:29:13.460496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:13.461658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:13.462571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 627/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Sep 5 10:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:13.468671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cf07-1fa4-4b3d-9a72-518bdf2eb355 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:13.553470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:13.572368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cf07-1fa4-4b3d-9a72-518bdf2eb355 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:13.605818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:13.606422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:13.606700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:13.606973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:13.607658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:13.607969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:13.609348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:13.617216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 650/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Sep 5 10:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:13.623400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:13.721195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11febb08-6330-4e80-8f50-d3ac9e2c8eb3 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:13.755309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:13.755954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:13.756239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:13.756518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:13.766293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:13.768308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:13.782726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:13.783865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:13.784956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:13.784956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:13.784956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:13.784956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 628/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:13.789872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:13.888089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273b79-4748-4be9-95c6-941757c34d55 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:13.920306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:13.920898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:13.921175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:13.921448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:13.922123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:13.922535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:13.924162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:13.935791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 651/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:13.942162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:13.972087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:14.040597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df048578-07b9-4c7e-85b7-0cbd8e2f25ee None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:14.073563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:14.074181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:14.074461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:14.074735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:14.082031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:14.083465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 10:29:14.094472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:14.095620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:14.096644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 629/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:14.101407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:14.105205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:14.200839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877df0e-e503-460a-88b3-993f072aef88 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:14.233269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:14.233857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:14.234134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:14.234404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:14.235117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:14.235417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:14.237641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:14.254952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 652/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Sep 5 10:29:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:14.260659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:14.347420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:14.356930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01408fcb-0c91-4b42-9a62-5b59e363bf2c None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:14.389936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:14.390530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:14.390809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:14.391078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:14.458151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:14.459943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:14.549071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:14.559504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 630/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Sep 5 10:29:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 10:29:14.565300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:14.626141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:14.664965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b01a-9212-4c91-9774-971f51a3a518 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:14.697853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:14.698474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:14.698754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:14.699025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:14.708860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:14.710241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 10:29:14.724801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:14.725941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 10:29:14.727040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 10:29:14.727040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 10:29:14.727040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:14.727040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 653/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:14.731493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:14.826322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecec26-7db1-4c7d-8092-37372c5fa15f None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:14.859049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:14.859656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:14.859943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:14.860213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:14.860864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:14.861164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:14.862572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:14.873457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 631/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Sep 5 10:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:14.879044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:14.977128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab7251-4e71-4476-adbd-efcabe5bb978 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:14.990115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:15.010455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:15.011096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:15.011376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:15.011677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:15.018845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:15.020327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 10:29:15.031244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:15.032319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: ERROR keystone.server.flask.application Sep 05 10:29:15.034206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 654/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Sep 5 10:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:15.039039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:15.095948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:15.155814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4ad30-d956-487d-aa4c-2205af395fc0 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:15.190807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578e3fe-af30-4f19-b5e6-94c76227f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:15.191412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e3fe-af30-4f19-b5e6-94c76227f8ce None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:15.191721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e3fe-af30-4f19-b5e6-94c76227f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:15.191995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e3fe-af30-4f19-b5e6-94c76227f8ce None admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:15.192679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578e3fe-af30-4f19-b5e6-94c76227f8ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:15.193007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578e3fe-af30-4f19-b5e6-94c76227f8ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:15.194420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578e3fe-af30-4f19-b5e6-94c76227f8ce None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:15.207089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 632/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Sep 5 10:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:15.213224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:15.315165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e6db-28df-46ca-aff8-9e78265d9097 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:15.348137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710432b5-0d41-4af6-90cc-d43e90836d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:15.348729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710432b5-0d41-4af6-90cc-d43e90836d67 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:15.349005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710432b5-0d41-4af6-90cc-d43e90836d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:15.349277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710432b5-0d41-4af6-90cc-d43e90836d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:15.349994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710432b5-0d41-4af6-90cc-d43e90836d67 None admin] RBAC: Adding query filter params (role.id=6df474b0ef494105b42c9715d6b2fb78, scope.project.id=f670453166984725b3361f82ce283c4b, user.id=9f1f8f4eb1c444edb1c197db41cd6f96) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:15.350299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710432b5-0d41-4af6-90cc-d43e90836d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:15.351752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710432b5-0d41-4af6-90cc-d43e90836d67 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:15.357280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 655/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Sep 5 10:29:15 2022] GET /identity/v3/role_assignments?user.id=9f1f8f4eb1c444edb1c197db41cd6f96&scope.project.id=f670453166984725b3361f82ce283c4b&role.id=6df474b0ef494105b42c9715d6b2fb78 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:17.277048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00cee3-5afe-4d83-88b9-2d7cc3492846 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:17.277582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00cee3-5afe-4d83-88b9-2d7cc3492846 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:17.277582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00cee3-5afe-4d83-88b9-2d7cc3492846 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:17.278946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 633/1288] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:29:17.284566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129a52b-e661-4ef3-8df5-30d33ecfb7d6 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:17.284994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129a52b-e661-4ef3-8df5-30d33ecfb7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:17.285121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129a52b-e661-4ef3-8df5-30d33ecfb7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:17.303121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3129a52b-e661-4ef3-8df5-30d33ecfb7d6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:29:17.304363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3129a52b-e661-4ef3-8df5-30d33ecfb7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:29:17.341927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:17.379673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 656/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:29:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:29:17.659804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00cee3-5afe-4d83-88b9-2d7cc3492846 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:17.758014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00cee3-5afe-4d83-88b9-2d7cc3492846 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:17.768852 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:17.797601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:17.798752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:17.799032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:17.799303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:17.799905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:17.801258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:17.809815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:17.811023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:17.811979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 634/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:29:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:17.817430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129a52b-e661-4ef3-8df5-30d33ecfb7d6 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:17.919344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129a52b-e661-4ef3-8df5-30d33ecfb7d6 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:17.952916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b952-27c4-422f-bf10-dee50e6d4588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:17.953514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b952-27c4-422f-bf10-dee50e6d4588 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:17.953793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b952-27c4-422f-bf10-dee50e6d4588 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:17.954065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b952-27c4-422f-bf10-dee50e6d4588 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:17.954698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b952-27c4-422f-bf10-dee50e6d4588 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:17.954999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b952-27c4-422f-bf10-dee50e6d4588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:17.956407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b952-27c4-422f-bf10-dee50e6d4588 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:17.961057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 657/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Sep 5 10:29:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:17.966711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:18.064602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440555-16da-47ac-b699-d6f07b4fe3b6 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:18.096910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40503d1-0a8a-4ad5-9697-833350c54a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:18.097504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40503d1-0a8a-4ad5-9697-833350c54a79 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:18.097788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40503d1-0a8a-4ad5-9697-833350c54a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:18.098066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40503d1-0a8a-4ad5-9697-833350c54a79 None admin] PATH_INFO: `/v3/services` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:18.098695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40503d1-0a8a-4ad5-9697-833350c54a79 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:18.099001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40503d1-0a8a-4ad5-9697-833350c54a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:18.100406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40503d1-0a8a-4ad5-9697-833350c54a79 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:18.104689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 635/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Sep 5 10:29:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:19.969843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066931d-c4b5-4f2d-8525-60361e4cfda1 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:19.970627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066931d-c4b5-4f2d-8525-60361e4cfda1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:19.970743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066931d-c4b5-4f2d-8525-60361e4cfda1 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:19.972109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 658/1293] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:29:19.977180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bd0d-9baa-453b-9080-2c807368d9ba None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:19.977587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bd0d-9baa-453b-9080-2c807368d9ba None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:19.977754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bd0d-9baa-453b-9080-2c807368d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:19.995930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1b52bd0d-9baa-453b-9080-2c807368d9ba None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:29:19.997099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b52bd0d-9baa-453b-9080-2c807368d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:29:20.027029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:20.064757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 636/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:29:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:29:20.335120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066931d-c4b5-4f2d-8525-60361e4cfda1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:20.365780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:20.436522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066931d-c4b5-4f2d-8525-60361e4cfda1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:20.476722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632b7e8-892d-40f9-bd12-d512a2295ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:20.477539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b7e8-892d-40f9-bd12-d512a2295ad0 None admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:20.477931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b7e8-892d-40f9-bd12-d512a2295ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:20.478348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632b7e8-892d-40f9-bd12-d512a2295ad0 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:20.479278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632b7e8-892d-40f9-bd12-d512a2295ad0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:20.481140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632b7e8-892d-40f9-bd12-d512a2295ad0 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:20.499820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 659/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Sep 5 10:29:20 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:29:22.402114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30946ee-0f4b-4cd7-b024-36a4d59095b1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:22.402618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30946ee-0f4b-4cd7-b024-36a4d59095b1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:22.402618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30946ee-0f4b-4cd7-b024-36a4d59095b1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:22.403971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 637/1296] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:29:22.409173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b56b-6f53-45ec-8cf3-167956d392ad None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:22.409572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b56b-6f53-45ec-8cf3-167956d392ad None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:22.409727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957b56b-6f53-45ec-8cf3-167956d392ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:22.428135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7957b56b-6f53-45ec-8cf3-167956d392ad None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:29:22.429327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7957b56b-6f53-45ec-8cf3-167956d392ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:29:22.503074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 660/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:29:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:29:22.768890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30946ee-0f4b-4cd7-b024-36a4d59095b1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:22.867360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30946ee-0f4b-4cd7-b024-36a4d59095b1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:22.900493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:22.901111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:22.901397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:22.901675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:22.902254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:22.903635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:22.912665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:22.913901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:22.914777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 638/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:29:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:22.919731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957b56b-6f53-45ec-8cf3-167956d392ad None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:22.938356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:23.018207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957b56b-6f53-45ec-8cf3-167956d392ad None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:23.051415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:23.051984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:23.052270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:23.052547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:23.053179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:23.053486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:23.054859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:23.059831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 661/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Sep 5 10:29:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:23.066331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:23.097197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:23.167362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed5eb-6aee-47c5-89e1-78c3ea779b43 None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:23.200660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1c1ea-0d6c-4a66-9585-dcfe5db6ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:23.201256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1c1ea-0d6c-4a66-9585-dcfe5db6ff9c None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:23.201530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1c1ea-0d6c-4a66-9585-dcfe5db6ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:23.201803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1c1ea-0d6c-4a66-9585-dcfe5db6ff9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:23.202489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1c1ea-0d6c-4a66-9585-dcfe5db6ff9c None admin] RBAC: Adding query filter params (interface=public, service_id=60db31e84ede4466a5300f958835905f, region_id=RegionOne) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:23.202796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1c1ea-0d6c-4a66-9585-dcfe5db6ff9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:23.204406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1c1ea-0d6c-4a66-9585-dcfe5db6ff9c None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:23.209320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 639/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Sep 5 10:29:23 2022] GET /identity/v3/endpoints?service_id=60db31e84ede4466a5300f958835905f&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:23.214965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:23.295127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:23.314885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502dde-b6e4-4a27-adee-4802e9980111 None admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:23.347699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0edd-9987-4bda-be47-eb1f972fae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:23.348288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0edd-9987-4bda-be47-eb1f972fae29 None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:23.348565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0edd-9987-4bda-be47-eb1f972fae29 None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:23.348833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0edd-9987-4bda-be47-eb1f972fae29 None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:23.349427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0edd-9987-4bda-be47-eb1f972fae29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:23.351068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0edd-9987-4bda-be47-eb1f972fae29 None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:23.359168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 662/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Sep 5 10:29:23 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:29:25.228651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89110702-42f3-41dd-8ae4-1a1c75874444 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:25.229150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89110702-42f3-41dd-8ae4-1a1c75874444 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:25.229266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89110702-42f3-41dd-8ae4-1a1c75874444 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:25.230523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 640/1302] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:29:25.235486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336bb03-2fdd-4f10-97df-c88e0500a0d4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:25.235893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336bb03-2fdd-4f10-97df-c88e0500a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:25.236059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336bb03-2fdd-4f10-97df-c88e0500a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:25.254427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3336bb03-2fdd-4f10-97df-c88e0500a0d4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:29:25.255614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3336bb03-2fdd-4f10-97df-c88e0500a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:29:25.321433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 663/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:29:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 10:29:25.602486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89110702-42f3-41dd-8ae4-1a1c75874444 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:25.695724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:25.702356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89110702-42f3-41dd-8ae4-1a1c75874444 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:25.734999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:25.736173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:25.736453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:25.736731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:25.737316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:25.738671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 10:29:25.747546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 10:29:25.748711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application with Lock( Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self._enter() Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application return self.creator() Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application created_value = creator( Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: ERROR keystone.server.flask.application Sep 05 10:29:25.749725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 641/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Sep 5 10:29:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 10:29:25.754812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336bb03-2fdd-4f10-97df-c88e0500a0d4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:25.828791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:25.851734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336bb03-2fdd-4f10-97df-c88e0500a0d4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:25.885278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9653e2f-010b-40b3-927d-9ec05794edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:25.885805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9653e2f-010b-40b3-927d-9ec05794edae None admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:25.886086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9653e2f-010b-40b3-927d-9ec05794edae None admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:25.886359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9653e2f-010b-40b3-927d-9ec05794edae None admin] PATH_INFO: `/v3/services` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:25.886986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9653e2f-010b-40b3-927d-9ec05794edae None admin] RBAC: Adding query filter params (name=placement) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:29:25.887286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9653e2f-010b-40b3-927d-9ec05794edae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:25.888695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9653e2f-010b-40b3-927d-9ec05794edae None admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:25.894428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 664/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Sep 5 10:29:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:29:25.900289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:29:25.997580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c612f7-aecf-4f93-9f78-8eedaac3a63d None admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:29:26.030441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32b8f7-f660-44fd-996a-4ac5a8238215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:29:26.031036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b8f7-f660-44fd-996a-4ac5a8238215 None admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:29:26.031321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b8f7-f660-44fd-996a-4ac5a8238215 None admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:29:26.031619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b8f7-f660-44fd-996a-4ac5a8238215 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:29:26.032442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32b8f7-f660-44fd-996a-4ac5a8238215 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:29:26.033802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32b8f7-f660-44fd-996a-4ac5a8238215 None admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:29:26.052750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 642/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:29:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:29:35.890885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=30 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:29:36.049116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:29.821707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620025-f2a7-452a-abaf-73b87737f4e7 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:29.822268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620025-f2a7-452a-abaf-73b87737f4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:29.822268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620025-f2a7-452a-abaf-73b87737f4e7 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:29.823788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 665/1307] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:29.830774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f8fb-8c43-4f23-8632-ca8ab476f893 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:29.831253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f8fb-8c43-4f23-8632-ca8ab476f893 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:29.831346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66f8fb-8c43-4f23-8632-ca8ab476f893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:29.995692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0e66f8fb-8c43-4f23-8632-ca8ab476f893 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:29.998296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e66f8fb-8c43-4f23-8632-ca8ab476f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:30.147631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 643/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:30:30.477894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99d67-56a3-4134-a22f-f64d23c62e2a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:30.478257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99d67-56a3-4134-a22f-f64d23c62e2a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:30.478446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99d67-56a3-4134-a22f-f64d23c62e2a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:30.479822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 666/1309] 10.222.0.16 () {54 vars in 965 bytes} [Mon Sep 5 10:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:30.491564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a7a14-ab16-4729-8c95-8648408ee80e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:30.492175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a7a14-ab16-4729-8c95-8648408ee80e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:30.492416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a7a14-ab16-4729-8c95-8648408ee80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:30.665213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c49a7a14-ab16-4729-8c95-8648408ee80e None None] MFA Rules not processed for user `e5f6af1603974cdba70d0d7d78e6777d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:30.666442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c49a7a14-ab16-4729-8c95-8648408ee80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:30.719175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:30.885993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 644/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Sep 5 10:30:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:30.896765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c99d67-56a3-4134-a22f-f64d23c62e2a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:30.898827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a1c99d67-56a3-4134-a22f-f64d23c62e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:31.147337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c99d67-56a3-4134-a22f-f64d23c62e2a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:31.249646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c41ab-c8c0-4d13-aecf-546c93454932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:31.250267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c41ab-c8c0-4d13-aecf-546c93454932 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:31.250712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c41ab-c8c0-4d13-aecf-546c93454932 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:31.250991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c41ab-c8c0-4d13-aecf-546c93454932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:31.252768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-486c41ab-c8c0-4d13-aecf-546c93454932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:31.324746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:31.397254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c41ab-c8c0-4d13-aecf-546c93454932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:31.398761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c41ab-c8c0-4d13-aecf-546c93454932 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:31.441311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 667/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:33.733276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42db9b-a4be-47f2-85a0-ef9420ca62ce None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:33.733765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42db9b-a4be-47f2-85a0-ef9420ca62ce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:33.733765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42db9b-a4be-47f2-85a0-ef9420ca62ce None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:33.735091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 645/1312] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:33.740508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18e6d-c166-4852-b6bf-599fa0b60179 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:33.741028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18e6d-c166-4852-b6bf-599fa0b60179 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:33.741028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab18e6d-c166-4852-b6bf-599fa0b60179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:33.821356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-cab18e6d-c166-4852-b6bf-599fa0b60179 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:33.822564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cab18e6d-c166-4852-b6bf-599fa0b60179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:33.931745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 668/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:34.222821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42db9b-a4be-47f2-85a0-ef9420ca62ce None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:34.224483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6d42db9b-a4be-47f2-85a0-ef9420ca62ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:34.349243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42db9b-a4be-47f2-85a0-ef9420ca62ce None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:34.430767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:34.433534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4311c-10f6-49f9-a7bb-74c90a4f689a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:34.434355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4311c-10f6-49f9-a7bb-74c90a4f689a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:34.434758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4311c-10f6-49f9-a7bb-74c90a4f689a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:34.435949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4311c-10f6-49f9-a7bb-74c90a4f689a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:34.438264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d6e4311c-10f6-49f9-a7bb-74c90a4f689a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:34.574022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4311c-10f6-49f9-a7bb-74c90a4f689a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:34.575519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4311c-10f6-49f9-a7bb-74c90a4f689a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:34.599500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 646/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:36.879451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c5551-b016-4b53-a92d-7e4320276a0b None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:36.879983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c5551-b016-4b53-a92d-7e4320276a0b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:36.880079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c5551-b016-4b53-a92d-7e4320276a0b None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:36.881362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 669/1315] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:36.886810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc3eb7-2f8a-415c-995f-d4cfad51538b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:36.887242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc3eb7-2f8a-415c-995f-d4cfad51538b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:36.887346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc3eb7-2f8a-415c-995f-d4cfad51538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:36.955577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-03bc3eb7-2f8a-415c-995f-d4cfad51538b None None] MFA Rules not processed for user `bcebeadc3f6a4531a15d8d448d340f79`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:36.956808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-03bc3eb7-2f8a-415c-995f-d4cfad51538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:37.012007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:37.057467 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 647/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:37.360544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64388d-93ca-4080-8daf-50e2c5a0b835 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:37.360942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64388d-93ca-4080-8daf-50e2c5a0b835 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:37.361219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64388d-93ca-4080-8daf-50e2c5a0b835 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:37.362741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 670/1317] 10.222.0.16 () {54 vars in 965 bytes} [Mon Sep 5 10:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:37.368839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824697ac-b6ed-4e4a-ba04-b43c70fb078b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:37.369130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824697ac-b6ed-4e4a-ba04-b43c70fb078b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:37.369407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824697ac-b6ed-4e4a-ba04-b43c70fb078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:37.450351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-824697ac-b6ed-4e4a-ba04-b43c70fb078b None None] MFA Rules not processed for user `e5f6af1603974cdba70d0d7d78e6777d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:37.451611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-824697ac-b6ed-4e4a-ba04-b43c70fb078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:37.527307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 648/1318] 10.222.0.16 () {58 vars in 1062 bytes} [Mon Sep 5 10:30:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:37.537105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64388d-93ca-4080-8daf-50e2c5a0b835 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:37.539463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ec64388d-93ca-4080-8daf-50e2c5a0b835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:37.553946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:37.654252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64388d-93ca-4080-8daf-50e2c5a0b835 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:37.729979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50244a7-e586-4d1d-a692-9f97251b7264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:37.730505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50244a7-e586-4d1d-a692-9f97251b7264 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:37.730776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50244a7-e586-4d1d-a692-9f97251b7264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:37.731054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50244a7-e586-4d1d-a692-9f97251b7264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:37.733643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c50244a7-e586-4d1d-a692-9f97251b7264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:37.797402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:37.845050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50244a7-e586-4d1d-a692-9f97251b7264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:37.846527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50244a7-e586-4d1d-a692-9f97251b7264 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:37.867565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 671/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:40.699731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982962-25c7-4cc8-9fb0-b89aa422af10 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:40.700271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982962-25c7-4cc8-9fb0-b89aa422af10 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:40.700271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982962-25c7-4cc8-9fb0-b89aa422af10 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:40.702382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 649/1320] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:40.707442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de992-f55d-4c3b-a55e-d437416e96d4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:40.707890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de992-f55d-4c3b-a55e-d437416e96d4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:40.708033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de992-f55d-4c3b-a55e-d437416e96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:40.772661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-360de992-f55d-4c3b-a55e-d437416e96d4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:40.773841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-360de992-f55d-4c3b-a55e-d437416e96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:40.869836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 672/1321] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:41.154961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982962-25c7-4cc8-9fb0-b89aa422af10 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:41.156538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b9982962-25c7-4cc8-9fb0-b89aa422af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:41.206140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:41.260351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982962-25c7-4cc8-9fb0-b89aa422af10 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:41.335015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9e16f-2ffd-405a-880f-ad8188e8798c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:41.335643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e16f-2ffd-405a-880f-ad8188e8798c service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:41.335931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e16f-2ffd-405a-880f-ad8188e8798c service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:41.336207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e16f-2ffd-405a-880f-ad8188e8798c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:41.337785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-56a9e16f-2ffd-405a-880f-ad8188e8798c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:41.432918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:41.446955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9e16f-2ffd-405a-880f-ad8188e8798c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:41.448427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9e16f-2ffd-405a-880f-ad8188e8798c service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:41.468709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 650/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:44.071764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a164-0415-4d1f-a2e3-d71267b9fa54 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:44.072407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a164-0415-4d1f-a2e3-d71267b9fa54 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:44.072407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a164-0415-4d1f-a2e3-d71267b9fa54 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:44.073656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 673/1323] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:44.079296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714a6c-7696-4844-a8db-c3eb5f13013f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:44.079739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714a6c-7696-4844-a8db-c3eb5f13013f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:44.079878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714a6c-7696-4844-a8db-c3eb5f13013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:44.149221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-54714a6c-7696-4844-a8db-c3eb5f13013f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:44.150417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-54714a6c-7696-4844-a8db-c3eb5f13013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:44.248192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 651/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:44.532498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a164-0415-4d1f-a2e3-d71267b9fa54 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:44.534038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d655a164-0415-4d1f-a2e3-d71267b9fa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:44.553374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:44.642846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a164-0415-4d1f-a2e3-d71267b9fa54 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:44.716615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc67f-212c-4668-80cc-1a54aaf51e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:44.717124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc67f-212c-4668-80cc-1a54aaf51e97 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:44.717407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc67f-212c-4668-80cc-1a54aaf51e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:44.717683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc67f-212c-4668-80cc-1a54aaf51e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:44.719350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a72dc67f-212c-4668-80cc-1a54aaf51e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:44.791920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:44.830995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc67f-212c-4668-80cc-1a54aaf51e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:44.832478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc67f-212c-4668-80cc-1a54aaf51e97 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:44.850609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 674/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:46.840851 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab537-05d1-4292-b88f-461f8a53f4df None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:46.841375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab537-05d1-4292-b88f-461f8a53f4df None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:46.841375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab537-05d1-4292-b88f-461f8a53f4df None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:46.842669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 652/1326] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:30:46.848079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d825a-916c-4daf-9b85-c54340bd44f8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:46.848497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d825a-916c-4daf-9b85-c54340bd44f8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:46.848758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d825a-916c-4daf-9b85-c54340bd44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:46.915859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2e8d825a-916c-4daf-9b85-c54340bd44f8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:46.917063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2e8d825a-916c-4daf-9b85-c54340bd44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:47.014901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 675/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:47.301392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ab537-05d1-4292-b88f-461f8a53f4df None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:47.302920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a68ab537-05d1-4292-b88f-461f8a53f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:47.363753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:47.409050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ab537-05d1-4292-b88f-461f8a53f4df None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:47.487756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48abd61-abe4-423c-becb-a8ccb71fcb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:47.488368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abd61-abe4-423c-becb-a8ccb71fcb28 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:47.488653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abd61-abe4-423c-becb-a8ccb71fcb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:47.488931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abd61-abe4-423c-becb-a8ccb71fcb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:47.490509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d48abd61-abe4-423c-becb-a8ccb71fcb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:47.598301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:47.600789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48abd61-abe4-423c-becb-a8ccb71fcb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:47.602636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48abd61-abe4-423c-becb-a8ccb71fcb28 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:47.621551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 653/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:49.599503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0dbd5-5525-45b5-871f-1d182b70c293 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:49.600022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0dbd5-5525-45b5-871f-1d182b70c293 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:49.600124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0dbd5-5525-45b5-871f-1d182b70c293 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:49.601414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 676/1329] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:49.607220 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e882-4827-4b4c-8a66-d6d51dbd5ea6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:49.607719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e882-4827-4b4c-8a66-d6d51dbd5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:49.607869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e882-4827-4b4c-8a66-d6d51dbd5ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:49.680488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9923e882-4827-4b4c-8a66-d6d51dbd5ea6 None None] MFA Rules not processed for user `bcebeadc3f6a4531a15d8d448d340f79`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:49.681711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9923e882-4827-4b4c-8a66-d6d51dbd5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:49.776593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 654/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:50.060028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0dbd5-5525-45b5-871f-1d182b70c293 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:50.061661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-92a0dbd5-5525-45b5-871f-1d182b70c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:50.102219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:50.181680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0dbd5-5525-45b5-871f-1d182b70c293 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:50.254276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74398ea-5b5e-4f35-ae25-45e182461fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:50.254885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74398ea-5b5e-4f35-ae25-45e182461fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:50.255163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74398ea-5b5e-4f35-ae25-45e182461fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:50.255436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74398ea-5b5e-4f35-ae25-45e182461fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:50.257080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b74398ea-5b5e-4f35-ae25-45e182461fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:50.334740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:50.373723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74398ea-5b5e-4f35-ae25-45e182461fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:50.375219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74398ea-5b5e-4f35-ae25-45e182461fb9 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:50.393670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 677/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:52.581998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663975b7-8213-4010-9b8d-d381772eaeff None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:52.582529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663975b7-8213-4010-9b8d-d381772eaeff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:52.582529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663975b7-8213-4010-9b8d-d381772eaeff None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:52.583920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 655/1332] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:52.589135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55416e75-ff68-465d-bb91-f71c6798c6f4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:52.589531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55416e75-ff68-465d-bb91-f71c6798c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:52.589679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55416e75-ff68-465d-bb91-f71c6798c6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:52.656442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-55416e75-ff68-465d-bb91-f71c6798c6f4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:52.657630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-55416e75-ff68-465d-bb91-f71c6798c6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:52.753114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 678/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:53.041116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663975b7-8213-4010-9b8d-d381772eaeff None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:53.042680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-663975b7-8213-4010-9b8d-d381772eaeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:53.111126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:53.146071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663975b7-8213-4010-9b8d-d381772eaeff None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:53.220528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fde08-cccf-4556-b002-9593a4cf71d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:53.221135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fde08-cccf-4556-b002-9593a4cf71d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:53.221448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fde08-cccf-4556-b002-9593a4cf71d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:53.221726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fde08-cccf-4556-b002-9593a4cf71d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:53.223331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e08fde08-cccf-4556-b002-9593a4cf71d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:53.331214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fde08-cccf-4556-b002-9593a4cf71d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:53.332692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fde08-cccf-4556-b002-9593a4cf71d4 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:53.342616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:53.352641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 656/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:55.586814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8589-bd82-43a6-85b9-7749ade7aa88 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:55.587375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8589-bd82-43a6-85b9-7749ade7aa88 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:55.587375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8589-bd82-43a6-85b9-7749ade7aa88 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:55.588720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 679/1335] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:55.594016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a3e9-f730-4429-8d41-7675428965c4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:55.594454 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a3e9-f730-4429-8d41-7675428965c4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:55.594551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a3e9-f730-4429-8d41-7675428965c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:55.660844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1355a3e9-f730-4429-8d41-7675428965c4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:55.662059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1355a3e9-f730-4429-8d41-7675428965c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:55.758679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 657/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:56.043012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac8589-bd82-43a6-85b9-7749ade7aa88 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:56.044617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3bac8589-bd82-43a6-85b9-7749ade7aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:56.083650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:56.149045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac8589-bd82-43a6-85b9-7749ade7aa88 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:56.222934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e652e7-745f-49a0-b7fb-f06c89adbd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:56.223525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e652e7-745f-49a0-b7fb-f06c89adbd7e service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:56.223828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e652e7-745f-49a0-b7fb-f06c89adbd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:56.224100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e652e7-745f-49a0-b7fb-f06c89adbd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:56.225676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c2e652e7-745f-49a0-b7fb-f06c89adbd7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:56.307412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:56.333675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e652e7-745f-49a0-b7fb-f06c89adbd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:56.335129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e652e7-745f-49a0-b7fb-f06c89adbd7e service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:56.353620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 680/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:30:58.598014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14befc61-552a-4a70-8c5b-cf8abb9f1bc8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:58.598548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14befc61-552a-4a70-8c5b-cf8abb9f1bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:58.598548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14befc61-552a-4a70-8c5b-cf8abb9f1bc8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:58.599986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 658/1338] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:30:58.605094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df327ea-c7da-4c2e-9aa1-da5a61512c76 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:58.605996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df327ea-c7da-4c2e-9aa1-da5a61512c76 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:58.606178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df327ea-c7da-4c2e-9aa1-da5a61512c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:58.672024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-1df327ea-c7da-4c2e-9aa1-da5a61512c76 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:30:58.673222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1df327ea-c7da-4c2e-9aa1-da5a61512c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:58.768370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 681/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:30:59.050714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14befc61-552a-4a70-8c5b-cf8abb9f1bc8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:30:59.052296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14befc61-552a-4a70-8c5b-cf8abb9f1bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:59.127158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:30:59.156137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14befc61-552a-4a70-8c5b-cf8abb9f1bc8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:30:59.232863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577b39-dffd-435b-b9e4-b43211c40d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:30:59.233629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577b39-dffd-435b-b9e4-b43211c40d47 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:30:59.234014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577b39-dffd-435b-b9e4-b43211c40d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:30:59.234386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577b39-dffd-435b-b9e4-b43211c40d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:30:59.236788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-14577b39-dffd-435b-b9e4-b43211c40d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:30:59.347493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577b39-dffd-435b-b9e4-b43211c40d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:30:59.348962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577b39-dffd-435b-b9e4-b43211c40d47 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:30:59.367810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 659/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:30:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:03.354586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c486b8-6265-4f10-9c7e-91b251958298 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:03.355075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c486b8-6265-4f10-9c7e-91b251958298 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:03.355075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c486b8-6265-4f10-9c7e-91b251958298 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:03.356792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 682/1341] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:31:03.362092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7e05-171e-4b47-af05-225bb8518cca None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:03.362500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7e05-171e-4b47-af05-225bb8518cca None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:03.362653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7e05-171e-4b47-af05-225bb8518cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:03.368471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:03.434133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-816b7e05-171e-4b47-af05-225bb8518cca None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:03.435712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-816b7e05-171e-4b47-af05-225bb8518cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:03.538171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 660/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:03.825523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c486b8-6265-4f10-9c7e-91b251958298 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:03.827082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-36c486b8-6265-4f10-9c7e-91b251958298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:03.876733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:03.932954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c486b8-6265-4f10-9c7e-91b251958298 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:04.007883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f880e-285e-494e-8838-d9301f71b9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:04.008487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f880e-285e-494e-8838-d9301f71b9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:04.008764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f880e-285e-494e-8838-d9301f71b9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:04.009036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f880e-285e-494e-8838-d9301f71b9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:04.010606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-381f880e-285e-494e-8838-d9301f71b9f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:04.108217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:04.126994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f880e-285e-494e-8838-d9301f71b9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:04.128498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f880e-285e-494e-8838-d9301f71b9f1 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:04.146879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 683/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:06.717832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caece503-d568-4c5f-be32-b03b51805ec6 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:06.718400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caece503-d568-4c5f-be32-b03b51805ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:06.718497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caece503-d568-4c5f-be32-b03b51805ec6 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:06.719885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 661/1344] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:06.725789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c04e-2e11-4b24-9ced-cbf101dd0a71 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:06.726340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c04e-2e11-4b24-9ced-cbf101dd0a71 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:06.726340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c04e-2e11-4b24-9ced-cbf101dd0a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:06.793510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-4514c04e-2e11-4b24-9ced-cbf101dd0a71 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:06.794714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4514c04e-2e11-4b24-9ced-cbf101dd0a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:06.892191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 684/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:07.176098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caece503-d568-4c5f-be32-b03b51805ec6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:07.177693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-caece503-d568-4c5f-be32-b03b51805ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:07.266504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:07.283952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caece503-d568-4c5f-be32-b03b51805ec6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:07.360303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f52a5-8096-4590-b760-eca90da7ad35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:07.360933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f52a5-8096-4590-b760-eca90da7ad35 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:07.361215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f52a5-8096-4590-b760-eca90da7ad35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:07.361490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f52a5-8096-4590-b760-eca90da7ad35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:07.363212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b76f52a5-8096-4590-b760-eca90da7ad35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:07.484513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f52a5-8096-4590-b760-eca90da7ad35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:07.486707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f52a5-8096-4590-b760-eca90da7ad35 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:07.507764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 662/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:11.402982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7b6d-5bba-462d-a01f-351fabc1e1f1 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:11.403482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7b6d-5bba-462d-a01f-351fabc1e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:11.403686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7b6d-5bba-462d-a01f-351fabc1e1f1 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:11.405402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 685/1347] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:31:11.410671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085b41-ee7a-4bad-b62f-71d4f9ba4d7d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:11.411078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085b41-ee7a-4bad-b62f-71d4f9ba4d7d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:11.411223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085b41-ee7a-4bad-b62f-71d4f9ba4d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:11.428369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:11.494054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-86085b41-ee7a-4bad-b62f-71d4f9ba4d7d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:11.496085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-86085b41-ee7a-4bad-b62f-71d4f9ba4d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:11.607837 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 663/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:11.893919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f7b6d-5bba-462d-a01f-351fabc1e1f1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:11.895520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0e6f7b6d-5bba-462d-a01f-351fabc1e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:11.955474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:12.006716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f7b6d-5bba-462d-a01f-351fabc1e1f1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:12.082090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc5ff4-6067-47b5-a64b-e1e6113f48d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:12.082704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc5ff4-6067-47b5-a64b-e1e6113f48d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:12.082985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc5ff4-6067-47b5-a64b-e1e6113f48d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:12.083271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc5ff4-6067-47b5-a64b-e1e6113f48d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:12.087609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6fbc5ff4-6067-47b5-a64b-e1e6113f48d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:12.197103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:12.202391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc5ff4-6067-47b5-a64b-e1e6113f48d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:12.203881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc5ff4-6067-47b5-a64b-e1e6113f48d8 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:12.221734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 686/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:17.215024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20a31-cba6-47d6-a927-80ded4e1c567 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:17.216050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20a31-cba6-47d6-a927-80ded4e1c567 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:17.216568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20a31-cba6-47d6-a927-80ded4e1c567 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:17.218780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 664/1350] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:31:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:17.224061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c593-5cc8-4b6a-a3b0-b8a4ec27afe2 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:17.224543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c593-5cc8-4b6a-a3b0-b8a4ec27afe2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:17.224825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c593-5cc8-4b6a-a3b0-b8a4ec27afe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:17.327570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2d94c593-5cc8-4b6a-a3b0-b8a4ec27afe2 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:17.332969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2d94c593-5cc8-4b6a-a3b0-b8a4ec27afe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:17.483755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 687/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:31:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:21.606115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=59 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:21.751696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2388e3-7326-448a-947d-4a06b190a57d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:21.752050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2388e3-7326-448a-947d-4a06b190a57d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:21.752356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2388e3-7326-448a-947d-4a06b190a57d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:21.754029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 665/1352] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:21.759185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941a0c4-c0ba-4eda-af52-559f801608c4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:21.759690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941a0c4-c0ba-4eda-af52-559f801608c4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:21.759806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941a0c4-c0ba-4eda-af52-559f801608c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:21.817824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:21.843292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-4941a0c4-c0ba-4eda-af52-559f801608c4 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:21.844530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4941a0c4-c0ba-4eda-af52-559f801608c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:21.969596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 688/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:31:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:23.193313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2829d-0e1b-4bbf-a6bd-0e1af9a2aec8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:23.193816 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2829d-0e1b-4bbf-a6bd-0e1af9a2aec8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:23.193897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2829d-0e1b-4bbf-a6bd-0e1af9a2aec8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:23.195358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 666/1354] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:23.200349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fc770-826e-4a2d-bf67-d9e8e2e2f307 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:23.200792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fc770-826e-4a2d-bf67-d9e8e2e2f307 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:23.201038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fc770-826e-4a2d-bf67-d9e8e2e2f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:23.280524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-043fc770-826e-4a2d-bf67-d9e8e2e2f307 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:23.281731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-043fc770-826e-4a2d-bf67-d9e8e2e2f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:23.326526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:23.394474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 689/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:26.751882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554185-b34b-418f-be96-2e123a872989 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:26.752396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554185-b34b-418f-be96-2e123a872989 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:26.752396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554185-b34b-418f-be96-2e123a872989 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:26.753749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 667/1356] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:26.759249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e100f0-5dd7-4e89-b872-5f31301f5788 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:26.763124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e100f0-5dd7-4e89-b872-5f31301f5788 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:26.763124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e100f0-5dd7-4e89-b872-5f31301f5788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:26.848564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-70e100f0-5dd7-4e89-b872-5f31301f5788 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:26.850164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-70e100f0-5dd7-4e89-b872-5f31301f5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:26.974135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 690/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:27.276209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e1c6-9682-4923-bd47-e8e4295d716e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:27.276654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e1c6-9682-4923-bd47-e8e4295d716e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:27.276938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490e1c6-9682-4923-bd47-e8e4295d716e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:27.278539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 668/1358] 10.222.0.16 () {54 vars in 962 bytes} [Mon Sep 5 10:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:27.287509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655b43-efe2-4492-a2a5-bbfec7ddc572 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:27.287956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655b43-efe2-4492-a2a5-bbfec7ddc572 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:27.288495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e655b43-efe2-4492-a2a5-bbfec7ddc572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:27.305545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:27.371000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0e655b43-efe2-4492-a2a5-bbfec7ddc572 None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:27.372387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0e655b43-efe2-4492-a2a5-bbfec7ddc572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:27.499382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 691/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Sep 5 10:31:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:31:27.510404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e1c6-9682-4923-bd47-e8e4295d716e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:27.512130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a490e1c6-9682-4923-bd47-e8e4295d716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:27.676453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490e1c6-9682-4923-bd47-e8e4295d716e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:27.757436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:27.799556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e4e59-ca98-4873-b629-7efda670d8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:27.800203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e4e59-ca98-4873-b629-7efda670d8b2 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:27.800484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e4e59-ca98-4873-b629-7efda670d8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:27.800760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e4e59-ca98-4873-b629-7efda670d8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:27.802661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc5e4e59-ca98-4873-b629-7efda670d8b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:27.894126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e4e59-ca98-4873-b629-7efda670d8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:27.897362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e4e59-ca98-4873-b629-7efda670d8b2 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:27.914858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 669/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:30.061288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b06f-7bf1-49e6-b2bd-b078843f7c91 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:30.061795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b06f-7bf1-49e6-b2bd-b078843f7c91 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:30.061795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8b06f-7bf1-49e6-b2bd-b078843f7c91 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:30.063262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 692/1361] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:30.068389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ace2-e59b-4cdc-bb44-5e630367fbf7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:30.068784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ace2-e59b-4cdc-bb44-5e630367fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:30.068943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ace2-e59b-4cdc-bb44-5e630367fbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:30.148122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8310ace2-e59b-4cdc-bb44-5e630367fbf7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:30.149440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8310ace2-e59b-4cdc-bb44-5e630367fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:30.191514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:30.265075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 670/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:30.573553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b06f-7bf1-49e6-b2bd-b078843f7c91 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:30.575210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4ed8b06f-7bf1-49e6-b2bd-b078843f7c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:30.647250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:30.736426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8b06f-7bf1-49e6-b2bd-b078843f7c91 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:30.857618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b77f37-d804-4921-a8c0-37e81b2ee1ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:30.858311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77f37-d804-4921-a8c0-37e81b2ee1ef service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:30.858586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77f37-d804-4921-a8c0-37e81b2ee1ef service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:30.858857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77f37-d804-4921-a8c0-37e81b2ee1ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:30.860492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d7b77f37-d804-4921-a8c0-37e81b2ee1ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:30.886692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:30.965687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b77f37-d804-4921-a8c0-37e81b2ee1ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:30.967488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b77f37-d804-4921-a8c0-37e81b2ee1ef service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:30.989801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 693/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:33.264741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d679a5-e62c-4b7a-8077-b139f6b23f04 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:33.265274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d679a5-e62c-4b7a-8077-b139f6b23f04 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:33.265358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d679a5-e62c-4b7a-8077-b139f6b23f04 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:33.266803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 671/1364] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:33.271867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec10acf-8002-43f6-824f-2303513b7ef0 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:33.272260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec10acf-8002-43f6-824f-2303513b7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:33.272425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec10acf-8002-43f6-824f-2303513b7ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:33.344816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7ec10acf-8002-43f6-824f-2303513b7ef0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:33.346033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7ec10acf-8002-43f6-824f-2303513b7ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:33.448888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:33.451643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 694/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:33.752427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2be98-b933-4d7c-ade5-21ede72fd9be None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:33.752709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2be98-b933-4d7c-ade5-21ede72fd9be None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:33.752983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2be98-b933-4d7c-ade5-21ede72fd9be None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:33.754438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 672/1366] 10.222.0.16 () {54 vars in 962 bytes} [Mon Sep 5 10:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:33.760629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04a455-9c18-4882-9bfa-e55aea2cae6a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:33.760923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04a455-9c18-4882-9bfa-e55aea2cae6a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:33.761329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04a455-9c18-4882-9bfa-e55aea2cae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:33.843254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ac04a455-9c18-4882-9bfa-e55aea2cae6a None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:33.844502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ac04a455-9c18-4882-9bfa-e55aea2cae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:33.968933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 695/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Sep 5 10:31:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:33.976701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2be98-b933-4d7c-ade5-21ede72fd9be None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:33.978213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-95b2be98-b933-4d7c-ade5-21ede72fd9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:34.143441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2be98-b933-4d7c-ade5-21ede72fd9be None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:34.164949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:34.264497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978a580-12f9-43c5-8d05-4e93ea870af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:34.265115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a580-12f9-43c5-8d05-4e93ea870af4 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:34.265648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a580-12f9-43c5-8d05-4e93ea870af4 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:34.265648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978a580-12f9-43c5-8d05-4e93ea870af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:34.267255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e978a580-12f9-43c5-8d05-4e93ea870af4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:34.367987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a580-12f9-43c5-8d05-4e93ea870af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:34.369626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978a580-12f9-43c5-8d05-4e93ea870af4 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:34.389604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 673/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:31:34.944693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d1ddb-cb35-4bf7-9e95-61feb0161837 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:34.945253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d1ddb-cb35-4bf7-9e95-61feb0161837 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:34.945478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d1ddb-cb35-4bf7-9e95-61feb0161837 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:34.946946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 696/1369] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:34.952405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b5f2e-88d3-41de-8f91-d0c63e98bb9d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:34.952695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b5f2e-88d3-41de-8f91-d0c63e98bb9d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:34.952971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b5f2e-88d3-41de-8f91-d0c63e98bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:34.986725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:35.023806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-740b5f2e-88d3-41de-8f91-d0c63e98bb9d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:35.025203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-740b5f2e-88d3-41de-8f91-d0c63e98bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:35.139660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 674/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:35.729403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0c23-f629-4079-9578-7d2fbacccc02 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:35.729403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0c23-f629-4079-9578-7d2fbacccc02 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:35.729403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad0c23-f629-4079-9578-7d2fbacccc02 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:35.732187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 697/1371] 10.222.0.16 () {54 vars in 964 bytes} [Mon Sep 5 10:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:35.735251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa073-7fc7-4c58-aa64-338bc80060f3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:35.735776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa073-7fc7-4c58-aa64-338bc80060f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:35.735930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa073-7fc7-4c58-aa64-338bc80060f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:35.823294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f42aa073-7fc7-4c58-aa64-338bc80060f3 None None] MFA Rules not processed for user `0621adefc6b340eba1ce85a4f64cae25`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:35.824921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f42aa073-7fc7-4c58-aa64-338bc80060f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:35.878178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:35.912915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 675/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Sep 5 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:35.921297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad0c23-f629-4079-9578-7d2fbacccc02 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:35.922875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-42ad0c23-f629-4079-9578-7d2fbacccc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:35.974822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:36.035573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad0c23-f629-4079-9578-7d2fbacccc02 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:36.117939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2acad8-fe7a-48bd-ab4d-2c35800c8744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:36.118556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2acad8-fe7a-48bd-ab4d-2c35800c8744 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:36.119475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2acad8-fe7a-48bd-ab4d-2c35800c8744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:36.119690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2acad8-fe7a-48bd-ab4d-2c35800c8744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:36.121383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-be2acad8-fe7a-48bd-ab4d-2c35800c8744 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:36.221420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:36.237203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2acad8-fe7a-48bd-ab4d-2c35800c8744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:36.238819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2acad8-fe7a-48bd-ab4d-2c35800c8744 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:36.264160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 698/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:36.409535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5055-6dd3-4b3a-b109-e326de6a86c5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:36.409893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5055-6dd3-4b3a-b109-e326de6a86c5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:36.410112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5055-6dd3-4b3a-b109-e326de6a86c5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:36.411473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 676/1374] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:36.418841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dbb65-1cda-404e-be45-e645c8d47ae2 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:36.419134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dbb65-1cda-404e-be45-e645c8d47ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:36.419417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dbb65-1cda-404e-be45-e645c8d47ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:36.485852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a35dbb65-1cda-404e-be45-e645c8d47ae2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:36.486969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a35dbb65-1cda-404e-be45-e645c8d47ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:36.585181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 699/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:36.875944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f5055-6dd3-4b3a-b109-e326de6a86c5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:36.877446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-695f5055-6dd3-4b3a-b109-e326de6a86c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:37.028182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f5055-6dd3-4b3a-b109-e326de6a86c5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:37.079864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:37.145187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905227a-967e-4dff-bb91-87d282ae6079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:37.145799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905227a-967e-4dff-bb91-87d282ae6079 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:37.146081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905227a-967e-4dff-bb91-87d282ae6079 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:37.146354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905227a-967e-4dff-bb91-87d282ae6079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:37.147971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7905227a-967e-4dff-bb91-87d282ae6079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:37.239474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905227a-967e-4dff-bb91-87d282ae6079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:37.241371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905227a-967e-4dff-bb91-87d282ae6079 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:37.260129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 677/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:39.223027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264941dc-06ba-4179-813f-44a51a0a7816 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:39.223558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264941dc-06ba-4179-813f-44a51a0a7816 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:39.223558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264941dc-06ba-4179-813f-44a51a0a7816 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:39.225276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 700/1377] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:39.231026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3a24-03ba-4330-8af4-fb0f75fa5efc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:39.231879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3a24-03ba-4330-8af4-fb0f75fa5efc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:39.232233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3a24-03ba-4330-8af4-fb0f75fa5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:39.428282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7dbf3a24-03ba-4330-8af4-fb0f75fa5efc None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:39.429423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7dbf3a24-03ba-4330-8af4-fb0f75fa5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:39.436332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:39.529844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 678/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:39.818215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264941dc-06ba-4179-813f-44a51a0a7816 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:39.819766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-264941dc-06ba-4179-813f-44a51a0a7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:39.884619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:39.978102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264941dc-06ba-4179-813f-44a51a0a7816 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:40.106180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa16f45-a98e-407b-8ddc-0aa7ad8b2b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:40.106709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16f45-a98e-407b-8ddc-0aa7ad8b2b8f service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:40.106993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16f45-a98e-407b-8ddc-0aa7ad8b2b8f service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:40.107271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa16f45-a98e-407b-8ddc-0aa7ad8b2b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:40.108891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cfa16f45-a98e-407b-8ddc-0aa7ad8b2b8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:40.133317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:40.211452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16f45-a98e-407b-8ddc-0aa7ad8b2b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:40.213851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa16f45-a98e-407b-8ddc-0aa7ad8b2b8f service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:40.233328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 701/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:42.196137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50a3e5-9cd5-49f9-b8dd-3d640aa71ef5 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:42.196716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50a3e5-9cd5-49f9-b8dd-3d640aa71ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:42.197415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50a3e5-9cd5-49f9-b8dd-3d640aa71ef5 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:42.199470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 679/1380] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:42.204840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb99f-c1d2-4d4c-87e8-a7e2fbfe9c3e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:42.205273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb99f-c1d2-4d4c-87e8-a7e2fbfe9c3e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:42.205379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb99f-c1d2-4d4c-87e8-a7e2fbfe9c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:42.275296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-8cabb99f-c1d2-4d4c-87e8-a7e2fbfe9c3e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:42.276615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8cabb99f-c1d2-4d4c-87e8-a7e2fbfe9c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:42.375202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:42.382257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 702/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:42.677447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50a3e5-9cd5-49f9-b8dd-3d640aa71ef5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:42.678958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ea50a3e5-9cd5-49f9-b8dd-3d640aa71ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:42.824237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:42.836748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50a3e5-9cd5-49f9-b8dd-3d640aa71ef5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:42.957075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117d388-4773-47c2-bfd8-7a9f5d9d5e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:42.957690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d388-4773-47c2-bfd8-7a9f5d9d5e3f service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:42.957975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d388-4773-47c2-bfd8-7a9f5d9d5e3f service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:42.958250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d388-4773-47c2-bfd8-7a9f5d9d5e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:42.959863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a117d388-4773-47c2-bfd8-7a9f5d9d5e3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:43.061758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117d388-4773-47c2-bfd8-7a9f5d9d5e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:43.063408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117d388-4773-47c2-bfd8-7a9f5d9d5e3f service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:43.074806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:43.089363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 680/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:45.073164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977f022-284d-4003-a8a5-7d40899b796d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:45.073698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977f022-284d-4003-a8a5-7d40899b796d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:45.073698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977f022-284d-4003-a8a5-7d40899b796d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:45.075052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 703/1383] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:45.080738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546537b1-5ea9-4321-8638-aa8ad2255fcb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:45.081189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546537b1-5ea9-4321-8638-aa8ad2255fcb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:45.081287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546537b1-5ea9-4321-8638-aa8ad2255fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:45.160679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-546537b1-5ea9-4321-8638-aa8ad2255fcb None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:45.161845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-546537b1-5ea9-4321-8638-aa8ad2255fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:45.263019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 681/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:45.573768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977f022-284d-4003-a8a5-7d40899b796d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:45.575281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b977f022-284d-4003-a8a5-7d40899b796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:45.722017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977f022-284d-4003-a8a5-7d40899b796d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:45.793824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:45.847103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65de57-9162-480f-834d-204a9f77286c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:45.848022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65de57-9162-480f-834d-204a9f77286c service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:45.848609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65de57-9162-480f-834d-204a9f77286c service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:45.849155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65de57-9162-480f-834d-204a9f77286c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:45.851966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9f65de57-9162-480f-834d-204a9f77286c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:45.961939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65de57-9162-480f-834d-204a9f77286c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:45.963996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65de57-9162-480f-834d-204a9f77286c service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:45.986558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 704/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:47.956834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643d03d-2313-407b-bb3e-df82db4c1cba None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:47.957368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643d03d-2313-407b-bb3e-df82db4c1cba None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:47.957368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643d03d-2313-407b-bb3e-df82db4c1cba None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:47.958667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 682/1386] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:47.964617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba742-5150-4bec-a33b-58b27fc8440e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:47.965087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba742-5150-4bec-a33b-58b27fc8440e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:47.965291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba742-5150-4bec-a33b-58b27fc8440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:48.036310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-792ba742-5150-4bec-a33b-58b27fc8440e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:48.037540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-792ba742-5150-4bec-a33b-58b27fc8440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:48.072268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:48.140600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 705/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:31:48.434312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643d03d-2313-407b-bb3e-df82db4c1cba None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:48.435882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d643d03d-2313-407b-bb3e-df82db4c1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:48.531874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:48.602441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643d03d-2313-407b-bb3e-df82db4c1cba None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:48.722699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb65f-373c-4968-8f1d-42a3cd3065ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:48.723239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb65f-373c-4968-8f1d-42a3cd3065ea service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:48.723527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb65f-373c-4968-8f1d-42a3cd3065ea service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:48.723883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb65f-373c-4968-8f1d-42a3cd3065ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:48.725512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7a9eb65f-373c-4968-8f1d-42a3cd3065ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:48.766590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:48.828567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb65f-373c-4968-8f1d-42a3cd3065ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:48.830845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb65f-373c-4968-8f1d-42a3cd3065ea service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:48.854218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 683/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:50.865660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe00e6-67f2-484f-9330-8903c15bfd4a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:50.866259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe00e6-67f2-484f-9330-8903c15bfd4a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:50.866259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe00e6-67f2-484f-9330-8903c15bfd4a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:50.867642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 706/1389] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:50.872988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371b3ed-4a1d-4b96-8b4c-cc10be02bdb6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:50.873409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371b3ed-4a1d-4b96-8b4c-cc10be02bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:50.873545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371b3ed-4a1d-4b96-8b4c-cc10be02bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:50.939498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2371b3ed-4a1d-4b96-8b4c-cc10be02bdb6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:50.940783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2371b3ed-4a1d-4b96-8b4c-cc10be02bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:51.038413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 684/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:51.273267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cbe7-b69c-4b99-a5fb-87904cafc9ba None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:51.273553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cbe7-b69c-4b99-a5fb-87904cafc9ba None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:51.273830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165cbe7-b69c-4b99-a5fb-87904cafc9ba None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:51.275463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 707/1391] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:51.280726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8fe3-57f3-426f-a57d-d5930ff7aed2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:51.281108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8fe3-57f3-426f-a57d-d5930ff7aed2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:51.281467 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8fe3-57f3-426f-a57d-d5930ff7aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:51.296882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:51.327966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cbe7-b69c-4b99-a5fb-87904cafc9ba None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:51.329476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2165cbe7-b69c-4b99-a5fb-87904cafc9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:51.349728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d57a8fe3-57f3-426f-a57d-d5930ff7aed2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:51.350920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d57a8fe3-57f3-426f-a57d-d5930ff7aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:51.450766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 685/1392] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:51.480859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165cbe7-b69c-4b99-a5fb-87904cafc9ba None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:51.497811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:51.593260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb7068-e1cd-4635-9cf6-741f4e0fed56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:51.593869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7068-e1cd-4635-9cf6-741f4e0fed56 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:51.594154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7068-e1cd-4635-9cf6-741f4e0fed56 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:51.594432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb7068-e1cd-4635-9cf6-741f4e0fed56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:51.596052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b2eb7068-e1cd-4635-9cf6-741f4e0fed56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:51.685645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb7068-e1cd-4635-9cf6-741f4e0fed56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:51.687281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb7068-e1cd-4635-9cf6-741f4e0fed56 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:51.705356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 708/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:31:51.761562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b222e3-a75c-48b3-8502-219b0a6b99ec None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:51.761921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b222e3-a75c-48b3-8502-219b0a6b99ec None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:51.762273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b222e3-a75c-48b3-8502-219b0a6b99ec None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:51.764054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 686/1394] 10.222.0.16 () {54 vars in 961 bytes} [Mon Sep 5 10:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:51.769203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b7072-6f3b-4bb0-9429-deefd21d0073 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:51.769737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b7072-6f3b-4bb0-9429-deefd21d0073 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:51.769932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b7072-6f3b-4bb0-9429-deefd21d0073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:51.798654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:51.859123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-482b7072-6f3b-4bb0-9429-deefd21d0073 None None] MFA Rules not processed for user `717ade6a084349a8864cf15ce0d827fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:51.860418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-482b7072-6f3b-4bb0-9429-deefd21d0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:51.941794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 709/1395] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Sep 5 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:31:51.949516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b222e3-a75c-48b3-8502-219b0a6b99ec None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:51.951006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-22b222e3-a75c-48b3-8502-219b0a6b99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:52.052265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:52.059680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b222e3-a75c-48b3-8502-219b0a6b99ec None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:52.136652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3160-d4e4-40ea-b025-4ea5ffe6c489 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717ade6a084349a8864cf15ce0d827fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:52.137263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3160-d4e4-40ea-b025-4ea5ffe6c489 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:52.137542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3160-d4e4-40ea-b025-4ea5ffe6c489 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:52.137817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3160-d4e4-40ea-b025-4ea5ffe6c489 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:52.139402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7ebf3160-d4e4-40ea-b025-4ea5ffe6c489 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:52.247825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3160-d4e4-40ea-b025-4ea5ffe6c489 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:52.249271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3160-d4e4-40ea-b025-4ea5ffe6c489 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:52.267958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 687/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:53.028921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9112-b6ed-418b-87cf-def4fcc7604e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:53.029413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9112-b6ed-418b-87cf-def4fcc7604e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:53.029506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9112-b6ed-418b-87cf-def4fcc7604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:53.099286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e56e9112-b6ed-418b-87cf-def4fcc7604e None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:53.100528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e56e9112-b6ed-418b-87cf-def4fcc7604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:53.160220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:53.188469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 710/1397] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:31:53.230602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e723d4-bff6-4fa8-9d4c-77e0a91c688d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:53.231100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e723d4-bff6-4fa8-9d4c-77e0a91c688d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:53.231312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e723d4-bff6-4fa8-9d4c-77e0a91c688d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:53.232844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 688/1398] 10.222.0.16 () {54 vars in 943 bytes} [Mon Sep 5 10:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:53.239364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbbbd-c1a9-4ad1-9b27-33bc0adcbee3 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:53.239687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbbbd-c1a9-4ad1-9b27-33bc0adcbee3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:53.240229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbbbd-c1a9-4ad1-9b27-33bc0adcbee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:53.317460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c8acbbbd-c1a9-4ad1-9b27-33bc0adcbee3 None None] MFA Rules not processed for user `e810111bda874bf2aa808991089c2197`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:53.318557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c8acbbbd-c1a9-4ad1-9b27-33bc0adcbee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:53.427778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 711/1399] 10.222.0.16 () {58 vars in 1040 bytes} [Mon Sep 5 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:31:53.437133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e723d4-bff6-4fa8-9d4c-77e0a91c688d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:53.438644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-26e723d4-bff6-4fa8-9d4c-77e0a91c688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:53.463513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:53.583114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e723d4-bff6-4fa8-9d4c-77e0a91c688d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:53.679240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b9ff-0e26-42c9-8d18-b72e4c630ce3 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:53.679527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b9ff-0e26-42c9-8d18-b72e4c630ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:53.679836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b9ff-0e26-42c9-8d18-b72e4c630ce3 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:53.681339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 712/1400] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:53.686220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48615d39-db2c-4ae6-b31e-89ed4808a7b8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:53.686507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48615d39-db2c-4ae6-b31e-89ed4808a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:53.686786 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48615d39-db2c-4ae6-b31e-89ed4808a7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:53.689345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:53.689956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:53.690236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:53.690624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:53.692300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:53.699907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:53.732558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:53.755047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-48615d39-db2c-4ae6-b31e-89ed4808a7b8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:53.756296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-48615d39-db2c-4ae6-b31e-89ed4808a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:53.779861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:53.781744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:53.789771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 689/1401] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:31:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:31:53.863654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 713/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:31:54.152929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:54.154147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:54.256267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af287d8-97ea-47b6-9496-a954f42eb154 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:54.316239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:54.385576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9cb0-3ade-4a17-bbf7-b570b0544175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:54.386189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9cb0-3ade-4a17-bbf7-b570b0544175 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:54.386465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9cb0-3ade-4a17-bbf7-b570b0544175 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:54.386733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9cb0-3ade-4a17-bbf7-b570b0544175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:54.388357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c96d9cb0-3ade-4a17-bbf7-b570b0544175 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:54.491059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9cb0-3ade-4a17-bbf7-b570b0544175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:54.492822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9cb0-3ade-4a17-bbf7-b570b0544175 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:54.512592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 690/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:56.620524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a630b-ccee-44b7-8ad1-9ba8b346bb14 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:56.621089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a630b-ccee-44b7-8ad1-9ba8b346bb14 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:56.621089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a630b-ccee-44b7-8ad1-9ba8b346bb14 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:56.622689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 714/1404] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:56.627669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d21f09-b03b-4ee4-bbae-5e08e532e57f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:56.628073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d21f09-b03b-4ee4-bbae-5e08e532e57f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:56.628248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d21f09-b03b-4ee4-bbae-5e08e532e57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:56.701022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-97d21f09-b03b-4ee4-bbae-5e08e532e57f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:56.702365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-97d21f09-b03b-4ee4-bbae-5e08e532e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:56.718542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:56.813080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 691/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:31:57.105609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a630b-ccee-44b7-8ad1-9ba8b346bb14 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:31:57.107210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7d6a630b-ccee-44b7-8ad1-9ba8b346bb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:57.234606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:57.277697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a630b-ccee-44b7-8ad1-9ba8b346bb14 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:31:57.402809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28029d-8104-453a-8ee1-97ef6485cfa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:31:57.403423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28029d-8104-453a-8ee1-97ef6485cfa4 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:57.403735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28029d-8104-453a-8ee1-97ef6485cfa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:57.404011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28029d-8104-453a-8ee1-97ef6485cfa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:57.405618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4f28029d-8104-453a-8ee1-97ef6485cfa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:57.499214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:31:57.514439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28029d-8104-453a-8ee1-97ef6485cfa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:31:57.516114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28029d-8104-453a-8ee1-97ef6485cfa4 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:31:57.541943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 715/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:31:59.533610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc7ab-8faf-4856-a267-ca8e53c30236 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:59.534164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc7ab-8faf-4856-a267-ca8e53c30236 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:59.534164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc7ab-8faf-4856-a267-ca8e53c30236 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:59.535546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 692/1407] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:31:59.540940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3406-d6a9-468f-97bb-1c41dbee3e34 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:31:59.541382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3406-d6a9-468f-97bb-1c41dbee3e34 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:31:59.541488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3406-d6a9-468f-97bb-1c41dbee3e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:31:59.619583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0b9e3406-d6a9-468f-97bb-1c41dbee3e34 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:31:59.620990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0b9e3406-d6a9-468f-97bb-1c41dbee3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:31:59.731753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 716/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:00.026306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc7ab-8faf-4856-a267-ca8e53c30236 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:00.028197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d5cbc7ab-8faf-4856-a267-ca8e53c30236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:00.203217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:00.206086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc7ab-8faf-4856-a267-ca8e53c30236 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:00.343287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52057912-9114-473b-85b2-1c50ec11f9be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:00.343950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52057912-9114-473b-85b2-1c50ec11f9be service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:00.344303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52057912-9114-473b-85b2-1c50ec11f9be service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:00.344644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52057912-9114-473b-85b2-1c50ec11f9be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:00.346252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-52057912-9114-473b-85b2-1c50ec11f9be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:00.448704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52057912-9114-473b-85b2-1c50ec11f9be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:00.450478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52057912-9114-473b-85b2-1c50ec11f9be service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:00.470026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 693/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:09.728909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=76 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:10.467132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:16.224956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088c77-fe28-47e5-b655-040cd2640b4f None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:16.225539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088c77-fe28-47e5-b655-040cd2640b4f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:16.225539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088c77-fe28-47e5-b655-040cd2640b4f None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:16.227356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 717/1410] 10.222.0.16 () {54 vars in 918 bytes} [Mon Sep 5 10:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:16.237814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06262-5b7c-4b21-8587-a3f50a093b73 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:16.237814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06262-5b7c-4b21-8587-a3f50a093b73 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:16.237814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e06262-5b7c-4b21-8587-a3f50a093b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:16.317187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a8e06262-5b7c-4b21-8587-a3f50a093b73 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:16.318394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a8e06262-5b7c-4b21-8587-a3f50a093b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:16.426000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 694/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Sep 5 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:16.441202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afac367-4562-443d-ad67-f8014efdec1d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:16.441484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afac367-4562-443d-ad67-f8014efdec1d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:16.441754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afac367-4562-443d-ad67-f8014efdec1d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:16.443092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 718/1412] 10.222.0.16 () {54 vars in 918 bytes} [Mon Sep 5 10:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:16.448187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf74c-ce1a-432b-abc4-13251f552e62 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:16.448471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf74c-ce1a-432b-abc4-13251f552e62 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:16.449017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf74c-ce1a-432b-abc4-13251f552e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:16.520439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:16.523417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-64acf74c-ce1a-432b-abc4-13251f552e62 None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:16.525362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-64acf74c-ce1a-432b-abc4-13251f552e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:16.640939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 695/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Sep 5 10:32:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:19.046625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b30f7-9f78-442b-a908-90f366678f76 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:19.047178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b30f7-9f78-442b-a908-90f366678f76 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:19.047178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b30f7-9f78-442b-a908-90f366678f76 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:19.048498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:19.053627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d078-7871-469f-9fdb-f0b6956dc964 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:19.054067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d078-7871-469f-9fdb-f0b6956dc964 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:19.054186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d078-7871-469f-9fdb-f0b6956dc964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:19.120667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2e80d078-7871-469f-9fdb-f0b6956dc964 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:19.121879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2e80d078-7871-469f-9fdb-f0b6956dc964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:19.177620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:19.219266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:19.512913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b30f7-9f78-442b-a908-90f366678f76 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:19.514615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8b9b30f7-9f78-442b-a908-90f366678f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:19.661491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b30f7-9f78-442b-a908-90f366678f76 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:19.734009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:19.773110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5692c-f4e8-4b3a-82dd-680186fb5d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:19.773639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5692c-f4e8-4b3a-82dd-680186fb5d5e service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:19.774444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5692c-f4e8-4b3a-82dd-680186fb5d5e service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:19.774797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5692c-f4e8-4b3a-82dd-680186fb5d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:19.776401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-41d5692c-f4e8-4b3a-82dd-680186fb5d5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:19.863662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5692c-f4e8-4b3a-82dd-680186fb5d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:19.865270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5692c-f4e8-4b3a-82dd-680186fb5d5e service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:19.882999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 720/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:20.773336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0af3e-a9f6-4c32-a9aa-3aa3499278ab None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:20.773994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0af3e-a9f6-4c32-a9aa-3aa3499278ab None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:20.773994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0af3e-a9f6-4c32-a9aa-3aa3499278ab None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:20.776217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:20.781018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4587e-23f6-4294-9d98-a9c4ef39623f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:20.781415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4587e-23f6-4294-9d98-a9c4ef39623f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:20.781566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4587e-23f6-4294-9d98-a9c4ef39623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:20.856037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a5f4587e-23f6-4294-9d98-a9c4ef39623f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:20.857235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a5f4587e-23f6-4294-9d98-a9c4ef39623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:20.885051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:20.954622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:21.105265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0af3e-a9f6-4c32-a9aa-3aa3499278ab None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:21.106709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f5a0af3e-a9f6-4c32-a9aa-3aa3499278ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:21.251678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0af3e-a9f6-4c32-a9aa-3aa3499278ab None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:21.290999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:21.363552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120dc1d-65d2-4155-9f83-15eb01bd48f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:21.364122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120dc1d-65d2-4155-9f83-15eb01bd48f6 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:21.364405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120dc1d-65d2-4155-9f83-15eb01bd48f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:21.364679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120dc1d-65d2-4155-9f83-15eb01bd48f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:21.366526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0120dc1d-65d2-4155-9f83-15eb01bd48f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:21.456243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120dc1d-65d2-4155-9f83-15eb01bd48f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:21.457829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120dc1d-65d2-4155-9f83-15eb01bd48f6 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:21.475468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 698/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:22.358876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd647-e84c-474d-af87-141eda927c7d None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:22.359410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd647-e84c-474d-af87-141eda927c7d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:22.359410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd647-e84c-474d-af87-141eda927c7d None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:22.360770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:22.365625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13ce9f-8277-4f6d-b441-28986635cccc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:22.366338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13ce9f-8277-4f6d-b441-28986635cccc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:22.366447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13ce9f-8277-4f6d-b441-28986635cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:22.420302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:22.441651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dc13ce9f-8277-4f6d-b441-28986635cccc None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:22.442894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc13ce9f-8277-4f6d-b441-28986635cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:22.540376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:22.693380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd647-e84c-474d-af87-141eda927c7d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:22.694889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-256cd647-e84c-474d-af87-141eda927c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:22.840821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd647-e84c-474d-af87-141eda927c7d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:22.853138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:22.955896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715dcc6-9e98-46bc-991f-5c93d3f775e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:22.956437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715dcc6-9e98-46bc-991f-5c93d3f775e5 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:22.956715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715dcc6-9e98-46bc-991f-5c93d3f775e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:22.956992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715dcc6-9e98-46bc-991f-5c93d3f775e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:22.958571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0715dcc6-9e98-46bc-991f-5c93d3f775e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:23.050181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715dcc6-9e98-46bc-991f-5c93d3f775e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:23.051835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715dcc6-9e98-46bc-991f-5c93d3f775e5 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:23.070282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 723/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:23.933115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26614ff-8936-48e5-ab72-b4d8f3359a7e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:23.933688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26614ff-8936-48e5-ab72-b4d8f3359a7e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:23.933806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26614ff-8936-48e5-ab72-b4d8f3359a7e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:23.935247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:23.940378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad996-e47e-4e43-9490-b07dbdea3a37 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:23.940800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad996-e47e-4e43-9490-b07dbdea3a37 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:23.940910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad996-e47e-4e43-9490-b07dbdea3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:23.960440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:24.017361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-9fdad996-e47e-4e43-9490-b07dbdea3a37 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:24.018550 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9fdad996-e47e-4e43-9490-b07dbdea3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:24.114504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:24.266584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26614ff-8936-48e5-ab72-b4d8f3359a7e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:24.268118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b26614ff-8936-48e5-ab72-b4d8f3359a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:24.376657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:24.412725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26614ff-8936-48e5-ab72-b4d8f3359a7e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:24.525469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6ceb1-e159-4c11-ab1f-40520577d506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:24.525995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6ceb1-e159-4c11-ab1f-40520577d506 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:24.526279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6ceb1-e159-4c11-ab1f-40520577d506 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:24.526554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6ceb1-e159-4c11-ab1f-40520577d506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:24.528179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-82f6ceb1-e159-4c11-ab1f-40520577d506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:24.604448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:24.618184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6ceb1-e159-4c11-ab1f-40520577d506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:24.619797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6ceb1-e159-4c11-ab1f-40520577d506 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:24.637649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 701/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:25.510185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f725afb-4987-474e-9847-59bd85a64ee6 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:25.510696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f725afb-4987-474e-9847-59bd85a64ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:25.510696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f725afb-4987-474e-9847-59bd85a64ee6 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:25.512024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:25.516901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2390-9605-483f-b272-d9ee22172073 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:25.517302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2390-9605-483f-b272-d9ee22172073 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:25.517460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba2390-9605-483f-b272-d9ee22172073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:25.593070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b3ba2390-9605-483f-b272-d9ee22172073 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:25.594278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3ba2390-9605-483f-b272-d9ee22172073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:25.690552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:25.841181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f725afb-4987-474e-9847-59bd85a64ee6 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:25.842645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8f725afb-4987-474e-9847-59bd85a64ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:25.927015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:25.989194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f725afb-4987-474e-9847-59bd85a64ee6 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:26.101896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e6caf-0c66-49b8-9a28-c4ae40d899d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:26.102515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e6caf-0c66-49b8-9a28-c4ae40d899d7 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:26.103007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e6caf-0c66-49b8-9a28-c4ae40d899d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:26.103288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e6caf-0c66-49b8-9a28-c4ae40d899d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:26.104933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fc7e6caf-0c66-49b8-9a28-c4ae40d899d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:26.153444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:26.193553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e6caf-0c66-49b8-9a28-c4ae40d899d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:26.195171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e6caf-0c66-49b8-9a28-c4ae40d899d7 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:26.214613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 726/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:27.032997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0ad7d-408d-4a7e-828c-8079524fe650 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:27.033526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0ad7d-408d-4a7e-828c-8079524fe650 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:27.033648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0ad7d-408d-4a7e-828c-8079524fe650 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:27.034908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:27.040301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30616-33d5-4ebc-8db7-661256653505 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:27.040808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30616-33d5-4ebc-8db7-661256653505 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:27.041282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30616-33d5-4ebc-8db7-661256653505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:27.117278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d9e30616-33d5-4ebc-8db7-661256653505 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:27.119388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d9e30616-33d5-4ebc-8db7-661256653505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:27.215158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:27.366935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0ad7d-408d-4a7e-828c-8079524fe650 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:27.368623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fdd0ad7d-408d-4a7e-828c-8079524fe650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:27.417213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:27.514760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0ad7d-408d-4a7e-828c-8079524fe650 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:27.631002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5260c45-490f-4a6b-8098-b73cf6dfd141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:27.631526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260c45-490f-4a6b-8098-b73cf6dfd141 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:27.631832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260c45-490f-4a6b-8098-b73cf6dfd141 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:27.632106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260c45-490f-4a6b-8098-b73cf6dfd141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:27.634242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d5260c45-490f-4a6b-8098-b73cf6dfd141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:27.641211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:27.723785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5260c45-490f-4a6b-8098-b73cf6dfd141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:27.725365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5260c45-490f-4a6b-8098-b73cf6dfd141 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:27.743158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 704/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:28.557481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbe770-715b-4817-bb57-079364c6074e None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:28.557881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbe770-715b-4817-bb57-079364c6074e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:28.558031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbe770-715b-4817-bb57-079364c6074e None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:28.559359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:28.564334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774d4c-84db-4717-bbda-aa9d0160ad86 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:28.564723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774d4c-84db-4717-bbda-aa9d0160ad86 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:28.564884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774d4c-84db-4717-bbda-aa9d0160ad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:28.639454 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aa774d4c-84db-4717-bbda-aa9d0160ad86 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:28.640689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa774d4c-84db-4717-bbda-aa9d0160ad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:28.706730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:28.736463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:28.888855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbe770-715b-4817-bb57-079364c6074e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:28.890327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-21cbe770-715b-4817-bb57-079364c6074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:28.908655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:29.038425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbe770-715b-4817-bb57-079364c6074e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:29.125830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:29.152687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83600daa-9512-4252-a4f3-525376166558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:29.153231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600daa-9512-4252-a4f3-525376166558 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:29.153511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600daa-9512-4252-a4f3-525376166558 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:29.153786 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600daa-9512-4252-a4f3-525376166558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:29.155380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-83600daa-9512-4252-a4f3-525376166558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:29.248888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83600daa-9512-4252-a4f3-525376166558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:29.250529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83600daa-9512-4252-a4f3-525376166558 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:29.268854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 729/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:30.077809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8032-5c4c-4a92-ba32-5c7974dafd5d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:30.078351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8032-5c4c-4a92-ba32-5c7974dafd5d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:30.078351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8032-5c4c-4a92-ba32-5c7974dafd5d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:30.079720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:30.084575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77bfe-8096-45f5-ab34-d6630d6dba2d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:30.085032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77bfe-8096-45f5-ab34-d6630d6dba2d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:30.085257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77bfe-8096-45f5-ab34-d6630d6dba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:30.162550 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a4e77bfe-8096-45f5-ab34-d6630d6dba2d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:30.163776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a4e77bfe-8096-45f5-ab34-d6630d6dba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:30.205820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:30.261734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:30.413111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8032-5c4c-4a92-ba32-5c7974dafd5d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:30.414581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7cce8032-5c4c-4a92-ba32-5c7974dafd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:30.560744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8032-5c4c-4a92-ba32-5c7974dafd5d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:30.614164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:30.673110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ce42d-ada4-47e5-b17f-cb32e9dc7981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:30.673641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce42d-ada4-47e5-b17f-cb32e9dc7981 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:30.673921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce42d-ada4-47e5-b17f-cb32e9dc7981 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:30.674193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ce42d-ada4-47e5-b17f-cb32e9dc7981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:30.675800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-288ce42d-ada4-47e5-b17f-cb32e9dc7981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:30.763814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ce42d-ada4-47e5-b17f-cb32e9dc7981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:30.765400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ce42d-ada4-47e5-b17f-cb32e9dc7981 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:30.784089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 707/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:31.594091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d465ce-5f80-492a-8a72-2f20de268c0f None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:31.594663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d465ce-5f80-492a-8a72-2f20de268c0f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:31.594663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d465ce-5f80-492a-8a72-2f20de268c0f None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:31.596007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:31.600807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e51e7-c3b0-498e-9c4a-1395fb098da6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:31.601239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e51e7-c3b0-498e-9c4a-1395fb098da6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:31.601368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e51e7-c3b0-498e-9c4a-1395fb098da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:31.677068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c49e51e7-c3b0-498e-9c4a-1395fb098da6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:31.678290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c49e51e7-c3b0-498e-9c4a-1395fb098da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:31.680328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:31.773873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:31.928200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d465ce-5f80-492a-8a72-2f20de268c0f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:31.929683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-72d465ce-5f80-492a-8a72-2f20de268c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:32.076664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d465ce-5f80-492a-8a72-2f20de268c0f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:32.104462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:32.191182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b1087-2e30-474c-acb8-4b987577c2d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:32.191753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b1087-2e30-474c-acb8-4b987577c2d3 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:32.192031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b1087-2e30-474c-acb8-4b987577c2d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:32.192323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b1087-2e30-474c-acb8-4b987577c2d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:32.193892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-735b1087-2e30-474c-acb8-4b987577c2d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:32.284132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b1087-2e30-474c-acb8-4b987577c2d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:32.285790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b1087-2e30-474c-acb8-4b987577c2d3 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:32.303959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 732/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:34.160145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4bfc5-11f7-4657-98f9-84722acc0705 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:34.160635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4bfc5-11f7-4657-98f9-84722acc0705 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:34.160751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4bfc5-11f7-4657-98f9-84722acc0705 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:34.162050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:34.167346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632406e6-05c7-443c-842c-aaa4a722d10c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:34.167765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632406e6-05c7-443c-842c-aaa4a722d10c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:34.167941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632406e6-05c7-443c-842c-aaa4a722d10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:34.209399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:34.235182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-632406e6-05c7-443c-842c-aaa4a722d10c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:34.236424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-632406e6-05c7-443c-842c-aaa4a722d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:34.333615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:34.619185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4bfc5-11f7-4657-98f9-84722acc0705 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:34.620753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5fd4bfc5-11f7-4657-98f9-84722acc0705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:34.723308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4bfc5-11f7-4657-98f9-84722acc0705 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:34.755536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:34.797775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b199b45-1141-4e3e-abea-4dca94daeed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:34.798377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199b45-1141-4e3e-abea-4dca94daeed1 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:34.798654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199b45-1141-4e3e-abea-4dca94daeed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:34.798924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b199b45-1141-4e3e-abea-4dca94daeed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:34.800526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9b199b45-1141-4e3e-abea-4dca94daeed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:34.912647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b199b45-1141-4e3e-abea-4dca94daeed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:34.916129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b199b45-1141-4e3e-abea-4dca94daeed1 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:34.935543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 710/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:37.092745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea969-7eda-444c-b3bc-6b7bf97f7328 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:37.093323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea969-7eda-444c-b3bc-6b7bf97f7328 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:37.093323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea969-7eda-444c-b3bc-6b7bf97f7328 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:37.094627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:37.100044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60340d37-b2f0-484b-abbe-4c7195ac52c0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:37.100475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60340d37-b2f0-484b-abbe-4c7195ac52c0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:37.100582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60340d37-b2f0-484b-abbe-4c7195ac52c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:37.166061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-60340d37-b2f0-484b-abbe-4c7195ac52c0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:37.167270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-60340d37-b2f0-484b-abbe-4c7195ac52c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:37.179850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:37.265647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:37.551023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea969-7eda-444c-b3bc-6b7bf97f7328 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:37.552605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2a4ea969-7eda-444c-b3bc-6b7bf97f7328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:37.658255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea969-7eda-444c-b3bc-6b7bf97f7328 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:37.671111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:37.731891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2474aba-06ca-4352-8908-92f2246b0250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:37.732498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2474aba-06ca-4352-8908-92f2246b0250 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:37.732779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2474aba-06ca-4352-8908-92f2246b0250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:37.733050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2474aba-06ca-4352-8908-92f2246b0250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:37.734638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d2474aba-06ca-4352-8908-92f2246b0250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:37.843295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2474aba-06ca-4352-8908-92f2246b0250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:37.844688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2474aba-06ca-4352-8908-92f2246b0250 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:37.863287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 735/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:40.089434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4af91-744c-4585-8959-9d8000c9cee1 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:40.089962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4af91-744c-4585-8959-9d8000c9cee1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:40.090085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4af91-744c-4585-8959-9d8000c9cee1 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:40.091460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:40.096881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0bf9-e1a8-4391-9070-236936a18da5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:40.097330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0bf9-e1a8-4391-9070-236936a18da5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:40.097440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0bf9-e1a8-4391-9070-236936a18da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:40.146419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:40.164715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-33fb0bf9-e1a8-4391-9070-236936a18da5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:40.165939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-33fb0bf9-e1a8-4391-9070-236936a18da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:40.261753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:40.553775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4af91-744c-4585-8959-9d8000c9cee1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:40.555383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-73b4af91-744c-4585-8959-9d8000c9cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:40.658287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4af91-744c-4585-8959-9d8000c9cee1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:40.698480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:40.732542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc239feb-9bec-49e3-ae05-5f613a04c7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:40.733145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc239feb-9bec-49e3-ae05-5f613a04c7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:40.733426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc239feb-9bec-49e3-ae05-5f613a04c7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:40.733703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc239feb-9bec-49e3-ae05-5f613a04c7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:40.735290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fc239feb-9bec-49e3-ae05-5f613a04c7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:40.843287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc239feb-9bec-49e3-ae05-5f613a04c7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:40.844673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc239feb-9bec-49e3-ae05-5f613a04c7d6 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:40.864129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 713/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:42.916331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff92b3-3347-48a9-bea5-131078eb2d25 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:42.917009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff92b3-3347-48a9-bea5-131078eb2d25 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:42.917009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff92b3-3347-48a9-bea5-131078eb2d25 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:42.918229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:42.923652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e87793-b07e-45f9-8de3-308002629b4b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:42.924050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e87793-b07e-45f9-8de3-308002629b4b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:42.924211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e87793-b07e-45f9-8de3-308002629b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:42.990892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b0e87793-b07e-45f9-8de3-308002629b4b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:42.992679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b0e87793-b07e-45f9-8de3-308002629b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:43.014395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:43.090453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:43.374638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff92b3-3347-48a9-bea5-131078eb2d25 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:43.376195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-61ff92b3-3347-48a9-bea5-131078eb2d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:43.481401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff92b3-3347-48a9-bea5-131078eb2d25 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:43.501727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:43.556455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb74625-b370-455c-8d26-6bd2a83a8b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:43.557073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74625-b370-455c-8d26-6bd2a83a8b6a service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:43.557358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74625-b370-455c-8d26-6bd2a83a8b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:43.557637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74625-b370-455c-8d26-6bd2a83a8b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:43.559232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-dcb74625-b370-455c-8d26-6bd2a83a8b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:43.669015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb74625-b370-455c-8d26-6bd2a83a8b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:43.670400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb74625-b370-455c-8d26-6bd2a83a8b6a service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:43.688993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 738/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:45.663871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c421e2-1bfb-4e7d-8ca9-ae76cf468591 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:45.664445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c421e2-1bfb-4e7d-8ca9-ae76cf468591 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:45.664445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c421e2-1bfb-4e7d-8ca9-ae76cf468591 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:45.666394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:45.671944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb02b-2ce2-4c49-a051-edf7d7129eba None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:45.672371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb02b-2ce2-4c49-a051-edf7d7129eba None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:45.672529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb02b-2ce2-4c49-a051-edf7d7129eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:45.736010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:45.738689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ecccb02b-2ce2-4c49-a051-edf7d7129eba None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:45.740509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ecccb02b-2ce2-4c49-a051-edf7d7129eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:45.837074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:46.124741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c421e2-1bfb-4e7d-8ca9-ae76cf468591 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:46.126292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1c421e2-1bfb-4e7d-8ca9-ae76cf468591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:46.227294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c421e2-1bfb-4e7d-8ca9-ae76cf468591 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:46.276559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:46.301420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac672-368c-4f64-95cb-9320e2508aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:46.302024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac672-368c-4f64-95cb-9320e2508aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:46.302304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac672-368c-4f64-95cb-9320e2508aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:46.302577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac672-368c-4f64-95cb-9320e2508aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:46.304177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b87ac672-368c-4f64-95cb-9320e2508aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:46.412813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ac672-368c-4f64-95cb-9320e2508aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:46.414171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ac672-368c-4f64-95cb-9320e2508aa5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:46.432825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 716/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:48.401815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406ecb-43df-478b-bbd8-db1be4d7cd23 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:48.402347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406ecb-43df-478b-bbd8-db1be4d7cd23 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:48.402347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406ecb-43df-478b-bbd8-db1be4d7cd23 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:48.403639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:48.408946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb02bc-776e-4e0a-b655-73f7365b0354 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:48.409395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb02bc-776e-4e0a-b655-73f7365b0354 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:48.409538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb02bc-776e-4e0a-b655-73f7365b0354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:48.476960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e1cb02bc-776e-4e0a-b655-73f7365b0354 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:48.478743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e1cb02bc-776e-4e0a-b655-73f7365b0354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:48.508127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:48.576022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:32:48.863244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406ecb-43df-478b-bbd8-db1be4d7cd23 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:48.864863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-57406ecb-43df-478b-bbd8-db1be4d7cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:48.969471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406ecb-43df-478b-bbd8-db1be4d7cd23 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:48.999261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:49.045587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0706517-3257-418a-b785-02820470724e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:49.046113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0706517-3257-418a-b785-02820470724e service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:49.046392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0706517-3257-418a-b785-02820470724e service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:49.046666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0706517-3257-418a-b785-02820470724e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:49.048279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f0706517-3257-418a-b785-02820470724e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:49.160972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0706517-3257-418a-b785-02820470724e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:49.162410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0706517-3257-418a-b785-02820470724e service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:49.180100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 741/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:51.200153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a8f2-aed9-4205-ace8-7cb8830e345e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:51.200668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a8f2-aed9-4205-ace8-7cb8830e345e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:51.200668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a8f2-aed9-4205-ace8-7cb8830e345e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:51.201988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:51.207370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee1bbd-2f44-49a1-bae4-2ebd30fd5199 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:51.207797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee1bbd-2f44-49a1-bae4-2ebd30fd5199 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:51.207977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee1bbd-2f44-49a1-bae4-2ebd30fd5199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:51.273838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d7ee1bbd-2f44-49a1-bae4-2ebd30fd5199 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:51.275029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d7ee1bbd-2f44-49a1-bae4-2ebd30fd5199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:51.284107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:51.372747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:51.660514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a8f2-aed9-4205-ace8-7cb8830e345e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:51.662086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f772a8f2-aed9-4205-ace8-7cb8830e345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:51.765577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a8f2-aed9-4205-ace8-7cb8830e345e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:51.820458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:51.838894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b953823-10ab-4da2-8268-a4178d7b82f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:51.839504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953823-10ab-4da2-8268-a4178d7b82f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:51.839814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953823-10ab-4da2-8268-a4178d7b82f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:51.840089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953823-10ab-4da2-8268-a4178d7b82f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:51.841674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4b953823-10ab-4da2-8268-a4178d7b82f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:51.948448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b953823-10ab-4da2-8268-a4178d7b82f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:51.949831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b953823-10ab-4da2-8268-a4178d7b82f0 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:51.968800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 719/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:53.948591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b7f9-5c2d-4cc1-8553-54ce0c70ca81 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:53.949141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b7f9-5c2d-4cc1-8553-54ce0c70ca81 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:53.949141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b7f9-5c2d-4cc1-8553-54ce0c70ca81 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:53.950517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:53.955905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17295ec-0926-4ee1-b6e8-3e247d2adf8a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:53.956333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17295ec-0926-4ee1-b6e8-3e247d2adf8a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:53.956446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17295ec-0926-4ee1-b6e8-3e247d2adf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:54.023611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e17295ec-0926-4ee1-b6e8-3e247d2adf8a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:54.024836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e17295ec-0926-4ee1-b6e8-3e247d2adf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:54.064040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:54.123039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:54.408603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7b7f9-5c2d-4cc1-8553-54ce0c70ca81 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:54.410152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b0b7b7f9-5c2d-4cc1-8553-54ce0c70ca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:54.513745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7b7f9-5c2d-4cc1-8553-54ce0c70ca81 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:54.551530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:54.587297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7aa9f-06df-4672-a04f-3c2d8cc61c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:54.588599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aa9f-06df-4672-a04f-3c2d8cc61c81 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:54.588885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aa9f-06df-4672-a04f-3c2d8cc61c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:54.589161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7aa9f-06df-4672-a04f-3c2d8cc61c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:54.590759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-62d7aa9f-06df-4672-a04f-3c2d8cc61c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:54.698782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7aa9f-06df-4672-a04f-3c2d8cc61c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:54.700203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7aa9f-06df-4672-a04f-3c2d8cc61c81 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:54.718570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 744/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:56.724195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65141-be7e-4ddb-aeb3-05f92a5299bb None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:56.724774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65141-be7e-4ddb-aeb3-05f92a5299bb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:56.724774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65141-be7e-4ddb-aeb3-05f92a5299bb None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:56.726129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:56.733777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3050-f1b2-47c9-81ea-c7000828165f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:56.734283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3050-f1b2-47c9-81ea-c7000828165f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:56.734390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb3050-f1b2-47c9-81ea-c7000828165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:56.822689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-6afb3050-f1b2-47c9-81ea-c7000828165f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:56.823951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6afb3050-f1b2-47c9-81ea-c7000828165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:56.844461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:56.942640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:32:57.268529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65141-be7e-4ddb-aeb3-05f92a5299bb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:32:57.270066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c0a65141-be7e-4ddb-aeb3-05f92a5299bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:57.402726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65141-be7e-4ddb-aeb3-05f92a5299bb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:32:57.470648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:57.479553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9460c5a-e963-470e-accf-ad4bf8811ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:32:57.480196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460c5a-e963-470e-accf-ad4bf8811ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:57.480477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460c5a-e963-470e-accf-ad4bf8811ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:57.480751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460c5a-e963-470e-accf-ad4bf8811ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:57.482410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e9460c5a-e963-470e-accf-ad4bf8811ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:57.593787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9460c5a-e963-470e-accf-ad4bf8811ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:32:57.595358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9460c5a-e963-470e-accf-ad4bf8811ad8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:32:57.614719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 722/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:32:59.556392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666395a4-5264-468c-abda-60e5d0438738 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:59.557065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666395a4-5264-468c-abda-60e5d0438738 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:59.557065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666395a4-5264-468c-abda-60e5d0438738 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:59.558635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:32:59.563996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65bc35-efb8-4ac2-8e9a-70e0528af988 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:32:59.564415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65bc35-efb8-4ac2-8e9a-70e0528af988 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:32:59.564592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65bc35-efb8-4ac2-8e9a-70e0528af988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:32:59.630773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1f65bc35-efb8-4ac2-8e9a-70e0528af988 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:32:59.632034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1f65bc35-efb8-4ac2-8e9a-70e0528af988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:32:59.682774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:32:59.732612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:00.018342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666395a4-5264-468c-abda-60e5d0438738 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:00.019919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-666395a4-5264-468c-abda-60e5d0438738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:00.124941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666395a4-5264-468c-abda-60e5d0438738 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:00.172504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:00.200465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea28b45-5427-4a20-9203-b26cd7fe40c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:00.201070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b45-5427-4a20-9203-b26cd7fe40c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:00.201347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b45-5427-4a20-9203-b26cd7fe40c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:00.201618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b45-5427-4a20-9203-b26cd7fe40c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:00.203211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-bea28b45-5427-4a20-9203-b26cd7fe40c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:00.311794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea28b45-5427-4a20-9203-b26cd7fe40c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:00.313209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea28b45-5427-4a20-9203-b26cd7fe40c8 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:00.331540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 747/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:33:09.730886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=22 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:10.329311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=66 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:19.988570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93a0c-9310-4b18-bd27-292f6c73db8f None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:19.989135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93a0c-9310-4b18-bd27-292f6c73db8f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:19.989135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93a0c-9310-4b18-bd27-292f6c73db8f None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:19.990459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 724/1471] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:19.995896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b002-0e3d-4e3a-9ca9-4bd1330a84e1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:19.996536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b002-0e3d-4e3a-9ca9-4bd1330a84e1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:19.996536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b002-0e3d-4e3a-9ca9-4bd1330a84e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:20.061666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-fff1b002-0e3d-4e3a-9ca9-4bd1330a84e1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:20.062873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fff1b002-0e3d-4e3a-9ca9-4bd1330a84e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:20.163436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 748/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:20.465572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b8e1-5c5d-4696-a979-b5a2f60cae70 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:20.465859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b8e1-5c5d-4696-a979-b5a2f60cae70 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:20.466136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b8e1-5c5d-4696-a979-b5a2f60cae70 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:20.467461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 725/1473] 10.222.0.16 () {54 vars in 961 bytes} [Mon Sep 5 10:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:20.472422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae035-52d6-4099-992a-cc221204774a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:20.472795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae035-52d6-4099-992a-cc221204774a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:20.473072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae035-52d6-4099-992a-cc221204774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:20.548614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-cc6ae035-52d6-4099-992a-cc221204774a None None] MFA Rules not processed for user `717ade6a084349a8864cf15ce0d827fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:20.549832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cc6ae035-52d6-4099-992a-cc221204774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:20.570793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:20.626806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 749/1474] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Sep 5 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:20.634279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b8e1-5c5d-4696-a979-b5a2f60cae70 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:20.635807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c691b8e1-5c5d-4696-a979-b5a2f60cae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:20.736849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b8e1-5c5d-4696-a979-b5a2f60cae70 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:20.812331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b19d8-f2cf-4f1a-8a57-300a62544f39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717ade6a084349a8864cf15ce0d827fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:20.812923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b19d8-f2cf-4f1a-8a57-300a62544f39 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:20.813204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b19d8-f2cf-4f1a-8a57-300a62544f39 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:20.813479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b19d8-f2cf-4f1a-8a57-300a62544f39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:20.815062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-989b19d8-f2cf-4f1a-8a57-300a62544f39 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:20.868671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:20.923734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b19d8-f2cf-4f1a-8a57-300a62544f39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:20.925160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b19d8-f2cf-4f1a-8a57-300a62544f39 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:20.943679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 726/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:33:22.934552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b40a4-211f-4934-815e-9f2c3b4eac33 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:22.935129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b40a4-211f-4934-815e-9f2c3b4eac33 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:22.935129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b40a4-211f-4934-815e-9f2c3b4eac33 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:22.936491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 750/1476] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:22.941582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22de692-56cb-4e36-89f9-980c52735cc4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:22.941997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22de692-56cb-4e36-89f9-980c52735cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:22.942134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22de692-56cb-4e36-89f9-980c52735cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:23.010378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d22de692-56cb-4e36-89f9-980c52735cc4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:23.012158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d22de692-56cb-4e36-89f9-980c52735cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:23.110931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 727/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:23.389605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b40a4-211f-4934-815e-9f2c3b4eac33 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:23.391074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f65b40a4-211f-4934-815e-9f2c3b4eac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:23.518616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b40a4-211f-4934-815e-9f2c3b4eac33 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:23.567043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:23.612361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f095e-fcd8-4e93-9ae2-6934ad934437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:23.612968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f095e-fcd8-4e93-9ae2-6934ad934437 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:23.613250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f095e-fcd8-4e93-9ae2-6934ad934437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:23.613525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f095e-fcd8-4e93-9ae2-6934ad934437 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:23.614166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f095e-fcd8-4e93-9ae2-6934ad934437 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:23.615980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-b62f095e-fcd8-4e93-9ae2-6934ad934437 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:33:23.615980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:33:23.615980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:33:23.617136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f095e-fcd8-4e93-9ae2-6934ad934437 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:23.637264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 751/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Sep 5 10:33:23 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:33:25.570777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b40c-eea8-4eef-a13a-92d626e15388 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:25.571368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b40c-eea8-4eef-a13a-92d626e15388 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:25.571368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b40c-eea8-4eef-a13a-92d626e15388 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:25.572706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 728/1479] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:25.578510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57023c5-90ae-4fc5-bbf9-ad74a74e0113 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:25.578933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57023c5-90ae-4fc5-bbf9-ad74a74e0113 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:25.579064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57023c5-90ae-4fc5-bbf9-ad74a74e0113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:25.648372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a57023c5-90ae-4fc5-bbf9-ad74a74e0113 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:25.649565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a57023c5-90ae-4fc5-bbf9-ad74a74e0113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:25.744171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 752/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:26.041469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50b40c-eea8-4eef-a13a-92d626e15388 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:26.043647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ad50b40c-eea8-4eef-a13a-92d626e15388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:26.053476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:26.190378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50b40c-eea8-4eef-a13a-92d626e15388 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:26.269749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:26.302521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21130e9-36ef-4cf3-a08b-6e9bfba3a46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:26.303043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21130e9-36ef-4cf3-a08b-6e9bfba3a46a service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:26.303321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21130e9-36ef-4cf3-a08b-6e9bfba3a46a service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:26.303609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21130e9-36ef-4cf3-a08b-6e9bfba3a46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:26.305473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c21130e9-36ef-4cf3-a08b-6e9bfba3a46a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:26.393106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21130e9-36ef-4cf3-a08b-6e9bfba3a46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:26.394699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21130e9-36ef-4cf3-a08b-6e9bfba3a46a service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:26.413098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 729/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:33:28.523371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd769-60dd-4e11-8ea5-e593ba8a3870 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.523955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd769-60dd-4e11-8ea5-e593ba8a3870 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.523955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd769-60dd-4e11-8ea5-e593ba8a3870 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.525281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 753/1482] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:28.531413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c8b8-0322-4cf3-a9be-6583addfce5f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:28.531853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c8b8-0322-4cf3-a9be-6583addfce5f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:28.532022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062c8b8-0322-4cf3-a9be-6583addfce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:28.597740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d062c8b8-0322-4cf3-a9be-6583addfce5f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:28.598953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d062c8b8-0322-4cf3-a9be-6583addfce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:28.645366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:28.696250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 730/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:28.987547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bd769-60dd-4e11-8ea5-e593ba8a3870 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:28.989096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-db5bd769-60dd-4e11-8ea5-e593ba8a3870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:29.013326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.093075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bd769-60dd-4e11-8ea5-e593ba8a3870 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:29.166494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3149f-8f07-4e08-9b8f-7b30ff87ec2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:29.167117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3149f-8f07-4e08-9b8f-7b30ff87ec2d service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:29.167386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3149f-8f07-4e08-9b8f-7b30ff87ec2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:29.167694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3149f-8f07-4e08-9b8f-7b30ff87ec2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:29.170812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a6d3149f-8f07-4e08-9b8f-7b30ff87ec2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:29.247935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:29.283431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3149f-8f07-4e08-9b8f-7b30ff87ec2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:29.284923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3149f-8f07-4e08-9b8f-7b30ff87ec2d service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:29.302707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 754/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:33:31.271640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1075d-0669-498b-bbb3-09f77b7f3f48 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.272203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1075d-0669-498b-bbb3-09f77b7f3f48 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.272203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1075d-0669-498b-bbb3-09f77b7f3f48 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.273600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 731/1485] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:31.279014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3a65a-0e70-45b2-9adb-52ea19bdd27a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.279421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3a65a-0e70-45b2-9adb-52ea19bdd27a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.279574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3a65a-0e70-45b2-9adb-52ea19bdd27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.345052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-24c3a65a-0e70-45b2-9adb-52ea19bdd27a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:31.346256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-24c3a65a-0e70-45b2-9adb-52ea19bdd27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:31.443584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 755/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:31.732399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1075d-0669-498b-bbb3-09f77b7f3f48 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:31.733931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bce1075d-0669-498b-bbb3-09f77b7f3f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:31.837761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1075d-0669-498b-bbb3-09f77b7f3f48 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:31.909496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:31.911116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcabdb-aab6-4736-bc46-e32f75846e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:31.911998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcabdb-aab6-4736-bc46-e32f75846e5f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:31.912345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcabdb-aab6-4736-bc46-e32f75846e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:31.912802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcabdb-aab6-4736-bc46-e32f75846e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:31.914824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7bfcabdb-aab6-4736-bc46-e32f75846e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:32.022897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcabdb-aab6-4736-bc46-e32f75846e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:32.024398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcabdb-aab6-4736-bc46-e32f75846e5f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:32.043257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 732/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:33:34.122305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3af5-fe85-42d9-bc91-2a1961711876 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.122843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3af5-fe85-42d9-bc91-2a1961711876 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.122843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3af5-fe85-42d9-bc91-2a1961711876 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.124216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 756/1488] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:34.129492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2f2ae-bde3-486a-b866-7c98ec9eb717 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.129911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2f2ae-bde3-486a-b866-7c98ec9eb717 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.130058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2f2ae-bde3-486a-b866-7c98ec9eb717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.196060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-20d2f2ae-bde3-486a-b866-7c98ec9eb717 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:34.197282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-20d2f2ae-bde3-486a-b866-7c98ec9eb717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:34.250032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:34.295343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 733/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:34.593354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd3af5-fe85-42d9-bc91-2a1961711876 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:34.594895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e3fd3af5-fe85-42d9-bc91-2a1961711876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:34.630885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:34.697682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd3af5-fe85-42d9-bc91-2a1961711876 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:34.770586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1b5a7-3e31-435d-b60a-2cda7c173485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:34.771191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b5a7-3e31-435d-b60a-2cda7c173485 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:34.771471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b5a7-3e31-435d-b60a-2cda7c173485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:34.771774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1b5a7-3e31-435d-b60a-2cda7c173485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:34.773356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3ec1b5a7-3e31-435d-b60a-2cda7c173485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:34.852568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:34.882578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b5a7-3e31-435d-b60a-2cda7c173485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:34.884070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1b5a7-3e31-435d-b60a-2cda7c173485 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:34.902733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 757/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:33:37.004985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521b059-86a0-4c4f-a0a3-2295664257cd None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.005473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521b059-86a0-4c4f-a0a3-2295664257cd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.005579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521b059-86a0-4c4f-a0a3-2295664257cd None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.006872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 734/1491] 10.222.0.16 () {54 vars in 927 bytes} [Mon Sep 5 10:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:33:37.012050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5701111-93f6-4842-9dad-8ba578af12f8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.012628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5701111-93f6-4842-9dad-8ba578af12f8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.012865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5701111-93f6-4842-9dad-8ba578af12f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.079385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b5701111-93f6-4842-9dad-8ba578af12f8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:33:37.080614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b5701111-93f6-4842-9dad-8ba578af12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:37.179685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 758/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Mon Sep 5 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:33:37.481257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521b059-86a0-4c4f-a0a3-2295664257cd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:33:37.482806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c521b059-86a0-4c4f-a0a3-2295664257cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:37.592343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521b059-86a0-4c4f-a0a3-2295664257cd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:33:37.670802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a825d-8c39-43ef-8f95-ecd2d3427fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:33:37.671403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a825d-8c39-43ef-8f95-ecd2d3427fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:33:37.671710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a825d-8c39-43ef-8f95-ecd2d3427fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:33:37.671985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a825d-8c39-43ef-8f95-ecd2d3427fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:33:37.673569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d64a825d-8c39-43ef-8f95-ecd2d3427fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:33:37.682359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:37.783151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a825d-8c39-43ef-8f95-ecd2d3427fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:33:37.784614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a825d-8c39-43ef-8f95-ecd2d3427fa8 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:33:37.802752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 735/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:33:47.177781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=82 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:33:47.800459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=50 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:50.488649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:50.489201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:50.489201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:50.680342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:50.681574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:50.776821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 759/1494] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:34:50.785598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c208f6-afa3-4cfc-aac4-3788504cf373 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:50.786107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c208f6-afa3-4cfc-aac4-3788504cf373 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:50.786216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c208f6-afa3-4cfc-aac4-3788504cf373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:50.861306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b2c208f6-afa3-4cfc-aac4-3788504cf373 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:50.862509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2c208f6-afa3-4cfc-aac4-3788504cf373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:50.957343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 736/1495] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:34:50.961956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:50.963127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:50.974887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1458232-2c56-46a9-a7d1-a9e21038e53d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.035808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.068388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.068995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.069274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.069564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.070203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:34:51.070501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.071547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:51.071547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:34:51.071547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:34:51.072455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.084460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 760/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:34:51.093511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c208f6-afa3-4cfc-aac4-3788504cf373 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.102847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c208f6-afa3-4cfc-aac4-3788504cf373 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.165018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.199234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.199872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.200724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.201031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.201688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.203447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:51.203447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 05 10:34:51.203447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: Sep 05 10:34:51.204716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.261152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 737/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:34:51 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:51.266122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.267657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:51.300481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c9d4b-258e-4219-8264-b752048b91ab admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.393259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.393890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.394173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.394474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.395153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.396196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:51.396196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:34:51.396196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:34:51.397470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.438170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 761/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:34:51 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:34:51.442276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.443870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:51.508611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d354b-2c99-493f-8cae-421adfb7602b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.591472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.602792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.603394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.603707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.603982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.604618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.605621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:51.605621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 05 10:34:51.605621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: Sep 05 10:34:51.607130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.619396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 738/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:34:51.624289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.626122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:51.637544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd14176-9159-4d6b-bf0c-7b912a1b407f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.662158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:51.732999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803becc5-0b54-4747-b1d7-d681dbca4ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.733609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803becc5-0b54-4747-b1d7-d681dbca4ece admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.733891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803becc5-0b54-4747-b1d7-d681dbca4ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.734167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803becc5-0b54-4747-b1d7-d681dbca4ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.734840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803becc5-0b54-4747-b1d7-d681dbca4ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.735898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-803becc5-0b54-4747-b1d7-d681dbca4ece admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:51.735898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:34:51.735898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:34:51.736790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803becc5-0b54-4747-b1d7-d681dbca4ece admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.749840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 762/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:34:51.754160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:51.759828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:51.793446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274257bf-e84a-426f-ad09-9713c0f46f1f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:51.886486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64eed1-a712-4a06-a41d-0b5cf4e48cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:51.887051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64eed1-a712-4a06-a41d-0b5cf4e48cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.887334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64eed1-a712-4a06-a41d-0b5cf4e48cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.887778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64eed1-a712-4a06-a41d-0b5cf4e48cbd admin admin] PATH_INFO: `/v3/projects/ac176c2124bd4fe9b33dd444c3fc8423/users/389bbebb03304d088137f5ad35c7581a/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:51.909874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64eed1-a712-4a06-a41d-0b5cf4e48cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac176c2124bd4fe9b33dd444c3fc8423, user_id=389bbebb03304d088137f5ad35c7581a, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:51.910893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-dd64eed1-a712-4a06-a41d-0b5cf4e48cbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:51.910893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 05 10:34:51.910893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: Sep 05 10:34:51.912920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64eed1-a712-4a06-a41d-0b5cf4e48cbd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:51.937052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 739/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:34:51 2022] PUT /identity/v3/projects/ac176c2124bd4fe9b33dd444c3fc8423/users/389bbebb03304d088137f5ad35c7581a/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:51.949187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53897-8255-4cc4-9a35-88bde66fa208 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:51.949464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53897-8255-4cc4-9a35-88bde66fa208 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:51.949744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53897-8255-4cc4-9a35-88bde66fa208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.008481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-71e53897-8255-4cc4-9a35-88bde66fa208 None None] MFA Rules not processed for user `389bbebb03304d088137f5ad35c7581a`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:52.009682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-71e53897-8255-4cc4-9a35-88bde66fa208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:52.086287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 763/1502] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:34:52.100838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7290071-9081-4bc0-b36e-31a8b8fdc64d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.101182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7290071-9081-4bc0-b36e-31a8b8fdc64d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.101462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7290071-9081-4bc0-b36e-31a8b8fdc64d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.102808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 740/1503] 10.222.0.16 () {54 vars in 964 bytes} [Mon Sep 5 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:52.108447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a007f23-8662-4c24-849f-2cb57d3c1b65 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.108733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a007f23-8662-4c24-849f-2cb57d3c1b65 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.109009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a007f23-8662-4c24-849f-2cb57d3c1b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.143013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.188003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0a007f23-8662-4c24-849f-2cb57d3c1b65 None None] MFA Rules not processed for user `0621adefc6b340eba1ce85a4f64cae25`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:52.189190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0a007f23-8662-4c24-849f-2cb57d3c1b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:52.264901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 764/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Sep 5 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:34:52.272614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7290071-9081-4bc0-b36e-31a8b8fdc64d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.274144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a7290071-9081-4bc0-b36e-31a8b8fdc64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:52.323746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.378363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7290071-9081-4bc0-b36e-31a8b8fdc64d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.454323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.454841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.455120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.455397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.457009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:52.559760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.561194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.564689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.580441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 741/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:34:52.626306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7d16-0136-4953-81d9-5c5f38e2b2e8 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.626758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7d16-0136-4953-81d9-5c5f38e2b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.626861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a7d16-0136-4953-81d9-5c5f38e2b2e8 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.628131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 765/1506] 10.222.0.16 () {52 vars in 830 bytes} [Mon Sep 5 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:34:52.631780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:52.633022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:52.731243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2932-f008-40ab-a93a-07559291d1da service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:52.826466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:52.827121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.827359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.827670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] PATH_INFO: `/v3/users/389bbebb03304d088137f5ad35c7581a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:52.839682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=389bbebb03304d088137f5ad35c7581a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:52.840719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:52.840719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 05 10:34:52.840719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: Sep 05 10:34:52.842001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:52.851493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:52.905903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389bbebb03304d088137f5ad35c7581a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:52.906363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389bbebb03304d088137f5ad35c7581a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:52.906890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389bbebb03304d088137f5ad35c7581a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:52.920738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389bbebb03304d088137f5ad35c7581a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:52.943568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389bbebb03304d088137f5ad35c7581a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:52.957894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 742/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:34:52 2022] DELETE /identity/v3/users/389bbebb03304d088137f5ad35c7581a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:34:52.962253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:52.962544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:52.962821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.020138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:34:53.021348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:53.096813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.110597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 766/1508] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:34:53.120353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.121637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:53.224873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883ef17-ae66-45cd-88f5-1965a41df055 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.280714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:34:53.301437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c157bbd-af39-4e2a-bbfc-86436539205f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.302057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157bbd-af39-4e2a-bbfc-86436539205f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.302354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157bbd-af39-4e2a-bbfc-86436539205f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.302625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157bbd-af39-4e2a-bbfc-86436539205f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.304262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8c157bbd-af39-4e2a-bbfc-86436539205f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:53.412403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c157bbd-af39-4e2a-bbfc-86436539205f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.413851 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c157bbd-af39-4e2a-bbfc-86436539205f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.436987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 743/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:34:53.803465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:34:53.804807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:34:53.817571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabec0b3-9032-4a80-addc-94a4705a9bd9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:34:53.917269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:34:53.917896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:34:53.918172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:34:53.918442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] PATH_INFO: `/v3/projects/ac176c2124bd4fe9b33dd444c3fc8423` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:34:53.929729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac176c2124bd4fe9b33dd444c3fc8423)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:34:53.930770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:34:53.930770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:34:53.930770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:34:53.932015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:34:53.989765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac176c2124bd4fe9b33dd444c3fc8423', 'request_id': 'req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:53.995753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac176c2124bd4fe9b33dd444c3fc8423', 'request_id': 'req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:54.009457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac176c2124bd4fe9b33dd444c3fc8423', 'request_id': 'req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:54.035022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] The token cache is being invalidate because project ac176c2124bd4fe9b33dd444c3fc8423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:34:54.035313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:54.035855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-53c14628-aed7-4b8f-b2b4-8cfe3e55d43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:34:54.037147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 767/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:34:53 2022] DELETE /identity/v3/projects/ac176c2124bd4fe9b33dd444c3fc8423 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:35:03.433300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=62 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:35:04.033022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:23.542575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fac31-326a-4808-8831-9e0165665f76 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:23.543169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fac31-326a-4808-8831-9e0165665f76 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:23.543169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fac31-326a-4808-8831-9e0165665f76 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:23.544535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:23.549678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff210b4-4cf2-4517-980f-8d076287a492 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:23.550102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff210b4-4cf2-4517-980f-8d076287a492 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:23.550242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff210b4-4cf2-4517-980f-8d076287a492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:23.636281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-8ff210b4-4cf2-4517-980f-8d076287a492 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:23.637476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8ff210b4-4cf2-4517-980f-8d076287a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:23.744770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:23.902427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fac31-326a-4808-8831-9e0165665f76 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:23.904602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b84fac31-326a-4808-8831-9e0165665f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:24.020328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fac31-326a-4808-8831-9e0165665f76 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:24.025674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237f9f3-b1fb-41ea-8a74-baac5c083679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:24.026272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237f9f3-b1fb-41ea-8a74-baac5c083679 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:24.026553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237f9f3-b1fb-41ea-8a74-baac5c083679 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:24.026825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237f9f3-b1fb-41ea-8a74-baac5c083679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:24.035137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237f9f3-b1fb-41ea-8a74-baac5c083679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:24.036741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237f9f3-b1fb-41ea-8a74-baac5c083679 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:24.046343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 745/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:24.878929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2310974-5b8f-4e22-8627-2f49f331b88c None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:24.879628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2310974-5b8f-4e22-8627-2f49f331b88c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:24.879628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2310974-5b8f-4e22-8627-2f49f331b88c None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:24.880916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:24.885619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7966-0d96-40fb-aa70-9fa9209000f4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:24.886063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7966-0d96-40fb-aa70-9fa9209000f4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:24.886166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7966-0d96-40fb-aa70-9fa9209000f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:24.905686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e2ef7966-0d96-40fb-aa70-9fa9209000f4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:24.906870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2ef7966-0d96-40fb-aa70-9fa9209000f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:24.914629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:25.069291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2310974-5b8f-4e22-8627-2f49f331b88c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:25.083408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2310974-5b8f-4e22-8627-2f49f331b88c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:25.089302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a448f0a-fb2b-4b0a-b4ea-520134b4607a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:25.089904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448f0a-fb2b-4b0a-b4ea-520134b4607a service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.090180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448f0a-fb2b-4b0a-b4ea-520134b4607a service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.090455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448f0a-fb2b-4b0a-b4ea-520134b4607a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.098960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a448f0a-fb2b-4b0a-b4ea-520134b4607a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:25.100567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a448f0a-fb2b-4b0a-b4ea-520134b4607a service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:25.110296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 770/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:25.321199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b302-9f9e-4fca-a458-baf10541fb5d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.321483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b302-9f9e-4fca-a458-baf10541fb5d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.321761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b302-9f9e-4fca-a458-baf10541fb5d None None] PATH_INFO: `/v3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.323072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 747/1517] 10.222.0.23 () {54 vars in 925 bytes} [Mon Sep 5 10:36:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:36:25.329327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9aa1f-4a39-4be9-89f3-a931c9b6b6a5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:25.329608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9aa1f-4a39-4be9-89f3-a931c9b6b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:25.329882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9aa1f-4a39-4be9-89f3-a931c9b6b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:25.388235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b4c9aa1f-4a39-4be9-89f3-a931c9b6b6a5 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:25.389544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b4c9aa1f-4a39-4be9-89f3-a931c9b6b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:25.407267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:25.460344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 771/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 5 10:36:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:34.325135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac40b-51f9-4b2a-8e29-e96b204379aa None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:34.325657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac40b-51f9-4b2a-8e29-e96b204379aa None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:34.325657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac40b-51f9-4b2a-8e29-e96b204379aa None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:34.326944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 748/1519] 10.222.0.16 () {54 vars in 961 bytes} [Mon Sep 5 10:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:34.331838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f862f-b1c0-4768-83e5-c0134c3e303c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:34.332239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f862f-b1c0-4768-83e5-c0134c3e303c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:34.332386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f862f-b1c0-4768-83e5-c0134c3e303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:34.352598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-1b0f862f-b1c0-4768-83e5-c0134c3e303c None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:34.353818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1b0f862f-b1c0-4768-83e5-c0134c3e303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:34.362921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 772/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Sep 5 10:36:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:34.370572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bac40b-51f9-4b2a-8e29-e96b204379aa None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:34.384108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bac40b-51f9-4b2a-8e29-e96b204379aa None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:34.388963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7630919-25ea-4e8c-a1c5-47c9b8e6e6d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:34.389557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7630919-25ea-4e8c-a1c5-47c9b8e6e6d1 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:34.389846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7630919-25ea-4e8c-a1c5-47c9b8e6e6d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:34.390129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7630919-25ea-4e8c-a1c5-47c9b8e6e6d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:34.398200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7630919-25ea-4e8c-a1c5-47c9b8e6e6d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:34.399814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7630919-25ea-4e8c-a1c5-47c9b8e6e6d1 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:34.409862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 749/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:36.351372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316e9e-ae99-4998-90e9-c82fad5b8345 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:36.351975 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316e9e-ae99-4998-90e9-c82fad5b8345 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:36.351975 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316e9e-ae99-4998-90e9-c82fad5b8345 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:36.353269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 773/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:36.357957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83921bc-c932-4368-b719-7388160e4764 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:36.358387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83921bc-c932-4368-b719-7388160e4764 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:36.358550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83921bc-c932-4368-b719-7388160e4764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:36.378276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d83921bc-c932-4368-b719-7388160e4764 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:36.379410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d83921bc-c932-4368-b719-7388160e4764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:36.387262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 750/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:36.542915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a316e9e-ae99-4998-90e9-c82fad5b8345 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:36.558986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a316e9e-ae99-4998-90e9-c82fad5b8345 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:36.565161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081702-d2d6-43e8-a108-9f9b84cd8f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:36.565756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081702-d2d6-43e8-a108-9f9b84cd8f17 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:36.566034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081702-d2d6-43e8-a108-9f9b84cd8f17 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:36.566306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081702-d2d6-43e8-a108-9f9b84cd8f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:36.574424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081702-d2d6-43e8-a108-9f9b84cd8f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:36.576053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081702-d2d6-43e8-a108-9f9b84cd8f17 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:36.586139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 774/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:37.418268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9855b23-c8aa-4d4b-9a0d-0b3b39877080 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:37.418783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9855b23-c8aa-4d4b-9a0d-0b3b39877080 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:37.418783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9855b23-c8aa-4d4b-9a0d-0b3b39877080 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:37.420136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 10:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:37.425687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ff95-80af-425b-92da-3b585f78a437 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:37.426089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ff95-80af-425b-92da-3b585f78a437 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:37.426236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803ff95-80af-425b-92da-3b585f78a437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:37.445379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d803ff95-80af-425b-92da-3b585f78a437 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:37.446565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d803ff95-80af-425b-92da-3b585f78a437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:37.454324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 10:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:37.607511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9855b23-c8aa-4d4b-9a0d-0b3b39877080 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:37.621968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9855b23-c8aa-4d4b-9a0d-0b3b39877080 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:37.627955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e4a96-8143-4d0b-8e51-2cce35dd944a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:37.628549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4a96-8143-4d0b-8e51-2cce35dd944a service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:37.628835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4a96-8143-4d0b-8e51-2cce35dd944a service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:37.629114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4a96-8143-4d0b-8e51-2cce35dd944a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:37.637021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e4a96-8143-4d0b-8e51-2cce35dd944a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:37.638602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e4a96-8143-4d0b-8e51-2cce35dd944a service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:37.648645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 752/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:41.384317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e61b-0ac5-4c52-8ed3-6bb2310faa6b None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:41.384841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e61b-0ac5-4c52-8ed3-6bb2310faa6b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:41.384841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e61b-0ac5-4c52-8ed3-6bb2310faa6b None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:41.386147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:41.391355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448153-042f-4598-8e08-5655ae41d99a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:41.391797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448153-042f-4598-8e08-5655ae41d99a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:41.392022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448153-042f-4598-8e08-5655ae41d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:41.412223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5d448153-042f-4598-8e08-5655ae41d99a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:41.413429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5d448153-042f-4598-8e08-5655ae41d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:41.422032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:41.710249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e61b-0ac5-4c52-8ed3-6bb2310faa6b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:41.712029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e490e61b-0ac5-4c52-8ed3-6bb2310faa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:41.790916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e61b-0ac5-4c52-8ed3-6bb2310faa6b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:41.794479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc85e13-486d-4765-bb09-310e2e606292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:41.795076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc85e13-486d-4765-bb09-310e2e606292 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:41.795360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc85e13-486d-4765-bb09-310e2e606292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:41.795659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc85e13-486d-4765-bb09-310e2e606292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:41.805362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc85e13-486d-4765-bb09-310e2e606292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:41.806836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc85e13-486d-4765-bb09-310e2e606292 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:41.816827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 777/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:43.710333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab86f-aacd-425c-bb75-55aa6a919d1d None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:43.710950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab86f-aacd-425c-bb75-55aa6a919d1d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:43.710950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab86f-aacd-425c-bb75-55aa6a919d1d None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:43.712271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:43.717306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bdcc8-0bf6-443a-a612-25912a2a7f34 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:43.717721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bdcc8-0bf6-443a-a612-25912a2a7f34 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:43.717912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bdcc8-0bf6-443a-a612-25912a2a7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:43.737913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-786bdcc8-0bf6-443a-a612-25912a2a7f34 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:43.739107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-786bdcc8-0bf6-443a-a612-25912a2a7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:43.746852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:44.035933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab86f-aacd-425c-bb75-55aa6a919d1d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:44.046662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab86f-aacd-425c-bb75-55aa6a919d1d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:44.050161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b34773-9a96-4a7c-842f-5b409afdf1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:44.050757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34773-9a96-4a7c-842f-5b409afdf1de service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:44.051040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34773-9a96-4a7c-842f-5b409afdf1de service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:44.051315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b34773-9a96-4a7c-842f-5b409afdf1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:44.060077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b34773-9a96-4a7c-842f-5b409afdf1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:44.061513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b34773-9a96-4a7c-842f-5b409afdf1de service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:44.071431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 755/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:47.363744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407e49-69fb-423c-9f7f-9fa601452ea6 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:47.364272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407e49-69fb-423c-9f7f-9fa601452ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:47.364272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407e49-69fb-423c-9f7f-9fa601452ea6 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:47.365548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:47.370653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb24c0-8959-4f6b-9eba-88031439ceb9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:47.371056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb24c0-8959-4f6b-9eba-88031439ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:47.371203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb24c0-8959-4f6b-9eba-88031439ceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:47.391489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7efb24c0-8959-4f6b-9eba-88031439ceb9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:47.392710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7efb24c0-8959-4f6b-9eba-88031439ceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:47.400362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:47.954736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407e49-69fb-423c-9f7f-9fa601452ea6 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:47.956505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-56407e49-69fb-423c-9f7f-9fa601452ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:48.021878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:36:48.035307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407e49-69fb-423c-9f7f-9fa601452ea6 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:48.038889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11875870-da8d-42a8-9342-485acbcacb55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:48.039491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875870-da8d-42a8-9342-485acbcacb55 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:48.039800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875870-da8d-42a8-9342-485acbcacb55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:48.040073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11875870-da8d-42a8-9342-485acbcacb55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:48.049617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875870-da8d-42a8-9342-485acbcacb55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:48.051051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11875870-da8d-42a8-9342-485acbcacb55 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:48.060318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 780/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:36:50.018809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7ebfb-7df8-4f95-94c4-ff7d93446a86 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:50.019389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7ebfb-7df8-4f95-94c4-ff7d93446a86 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:50.019389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7ebfb-7df8-4f95-94c4-ff7d93446a86 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:50.020773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 10:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:36:50.025860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eccef-1229-4b3d-ba11-099576511fba None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:50.026279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eccef-1229-4b3d-ba11-099576511fba None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:50.026420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eccef-1229-4b3d-ba11-099576511fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:50.046836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-049eccef-1229-4b3d-ba11-099576511fba None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:36:50.048065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-049eccef-1229-4b3d-ba11-099576511fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:50.055860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:36:50.607522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7ebfb-7df8-4f95-94c4-ff7d93446a86 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:36:50.609931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-67e7ebfb-7df8-4f95-94c4-ff7d93446a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:36:50.622885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7ebfb-7df8-4f95-94c4-ff7d93446a86 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:36:50.627234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432764d-4d31-43eb-8efc-bed39bafa198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:36:50.628120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432764d-4d31-43eb-8efc-bed39bafa198 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:36:50.628567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432764d-4d31-43eb-8efc-bed39bafa198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:36:50.628846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432764d-4d31-43eb-8efc-bed39bafa198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:36:50.637816 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432764d-4d31-43eb-8efc-bed39bafa198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:36:50.639278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432764d-4d31-43eb-8efc-bed39bafa198 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:36:50.648797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 758/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:37:00.041402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=11 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:37:00.644627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:15.577581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf34f6-bbdb-4f7a-8ab8-314120c9f4ef None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:15.578446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf34f6-bbdb-4f7a-8ab8-314120c9f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:15.578446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf34f6-bbdb-4f7a-8ab8-314120c9f4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:15.604586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0baf34f6-bbdb-4f7a-8ab8-314120c9f4ef None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:15.606348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0baf34f6-bbdb-4f7a-8ab8-314120c9f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:15.619231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 782/1540] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:15.629322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d1cc-8ea2-4d6f-a9b1-80776afbf888 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:15.629880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d1cc-8ea2-4d6f-a9b1-80776afbf888 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:15.629880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979d1cc-8ea2-4d6f-a9b1-80776afbf888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:15.664398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7979d1cc-8ea2-4d6f-a9b1-80776afbf888 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:15.665625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7979d1cc-8ea2-4d6f-a9b1-80776afbf888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:15.678382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 759/1541] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:15.683186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf34f6-bbdb-4f7a-8ab8-314120c9f4ef None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:15.698856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf34f6-bbdb-4f7a-8ab8-314120c9f4ef None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:15.708514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:15.709422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:15.709921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:15.710440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:15.711309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:15.711861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:15.713697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:15.733207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 783/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:15.743416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d1cc-8ea2-4d6f-a9b1-80776afbf888 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:15.759168 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979d1cc-8ea2-4d6f-a9b1-80776afbf888 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:15.768234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:15.768859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:15.769969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:15.769969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:15.770305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:15.772386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:15.832384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 760/1543] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:15 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:15.837032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:15.852949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b12067-b543-4ffd-ab30-fa11a50e6231 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:15.947615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:15.948670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:15.949170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:15.949659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:15.950525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:15.953468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:15.993784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 784/1544] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:15 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:15.998572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.018406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9bd3-e71f-4fcf-afed-17818ff14d92 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.025825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea828a-7d0e-4fe9-8ad2-5db9687cf4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.026469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea828a-7d0e-4fe9-8ad2-5db9687cf4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.026753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea828a-7d0e-4fe9-8ad2-5db9687cf4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.027031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea828a-7d0e-4fe9-8ad2-5db9687cf4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.029405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea828a-7d0e-4fe9-8ad2-5db9687cf4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.032079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea828a-7d0e-4fe9-8ad2-5db9687cf4c6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.045875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 761/1545] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:16.051364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.067349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89739f-df44-44f7-8f65-a93a581a6cdf admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.074634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.075694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.076201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.076889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.078332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.080795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.087361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834e6a-da42-45c1-9447-8806a6db44f3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.087577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834e6a-da42-45c1-9447-8806a6db44f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.091764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834e6a-da42-45c1-9447-8806a6db44f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.112228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 785/1546] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:16.125442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.141543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bd834e6a-da42-45c1-9447-8806a6db44f3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.142783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd834e6a-da42-45c1-9447-8806a6db44f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.154242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d4817-f96b-41ce-b1e9-e49907263149 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.163073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 762/1547] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:16.164511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919c45-f2d2-4e94-b3a4-2ddb20cbb123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.165203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c45-f2d2-4e94-b3a4-2ddb20cbb123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.165490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c45-f2d2-4e94-b3a4-2ddb20cbb123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.165768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c45-f2d2-4e94-b3a4-2ddb20cbb123 admin admin] PATH_INFO: `/v3/projects/c7d6b91294034080a8e17ee3de3ad22d/users/ee3a89d96fca43148c1d955f30ca9e22/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.181160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293387d0-8343-4c18-aee7-39092cb4a34f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.181510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293387d0-8343-4c18-aee7-39092cb4a34f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.181719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293387d0-8343-4c18-aee7-39092cb4a34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.193259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919c45-f2d2-4e94-b3a4-2ddb20cbb123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d6b91294034080a8e17ee3de3ad22d, user_id=ee3a89d96fca43148c1d955f30ca9e22, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.194336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-3f919c45-f2d2-4e94-b3a4-2ddb20cbb123 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:38:16.194336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:38:16.194336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:38:16.196323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919c45-f2d2-4e94-b3a4-2ddb20cbb123 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.220145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-293387d0-8343-4c18-aee7-39092cb4a34f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.221398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-293387d0-8343-4c18-aee7-39092cb4a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.225415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 786/1548] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:16 2022] PUT /identity/v3/projects/c7d6b91294034080a8e17ee3de3ad22d/users/ee3a89d96fca43148c1d955f30ca9e22/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:16.231691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28c5f-6dab-4a63-a431-e49e7beef0c2 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.231998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28c5f-6dab-4a63-a431-e49e7beef0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.232743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28c5f-6dab-4a63-a431-e49e7beef0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.268962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a2d28c5f-6dab-4a63-a431-e49e7beef0c2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.270192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a2d28c5f-6dab-4a63-a431-e49e7beef0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.349648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 763/1549] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.350969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42829a4f-37cb-4bbf-a977-2cde71b8d2ac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.351157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42829a4f-37cb-4bbf-a977-2cde71b8d2ac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.351402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42829a4f-37cb-4bbf-a977-2cde71b8d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.387673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-42829a4f-37cb-4bbf-a977-2cde71b8d2ac None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.388904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-42829a4f-37cb-4bbf-a977-2cde71b8d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.392964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 787/1550] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:16.393821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28c5f-6dab-4a63-a431-e49e7beef0c2 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.410218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 764/1551] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.417057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ff91d-d07b-42e7-8897-53cbcebaf3d4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.417616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ff91d-d07b-42e7-8897-53cbcebaf3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.418136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ff91d-d07b-42e7-8897-53cbcebaf3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.418851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28c5f-6dab-4a63-a431-e49e7beef0c2 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.441536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1fd0f-b70b-4e52-9a1d-ec9992f69b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.442608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fd0f-b70b-4e52-9a1d-ec9992f69b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.444149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fd0f-b70b-4e52-9a1d-ec9992f69b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.444149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fd0f-b70b-4e52-9a1d-ec9992f69b94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.444854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1fd0f-b70b-4e52-9a1d-ec9992f69b94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:16.445166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1fd0f-b70b-4e52-9a1d-ec9992f69b94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.446795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1fd0f-b70b-4e52-9a1d-ec9992f69b94 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.451971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1f1ff91d-d07b-42e7-8897-53cbcebaf3d4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.453580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1f1ff91d-d07b-42e7-8897-53cbcebaf3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.460787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 788/1552] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:16.463373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0720adc-d89f-4c23-98ce-7713ed2d1fe9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.463691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0720adc-d89f-4c23-98ce-7713ed2d1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.463975 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0720adc-d89f-4c23-98ce-7713ed2d1fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.465505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 765/1553] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.466782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ff91d-d07b-42e7-8897-53cbcebaf3d4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.490825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a0720adc-d89f-4c23-98ce-7713ed2d1fe9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.492065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a0720adc-d89f-4c23-98ce-7713ed2d1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.505169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 789/1554] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.505169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9cb3b-5bc2-40ec-bfcc-ada818a3cc1a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.505169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9cb3b-5bc2-40ec-bfcc-ada818a3cc1a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.505169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9cb3b-5bc2-40ec-bfcc-ada818a3cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.532491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-93c9cb3b-5bc2-40ec-bfcc-ada818a3cc1a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.533695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-93c9cb3b-5bc2-40ec-bfcc-ada818a3cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.541437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ff91d-d07b-42e7-8897-53cbcebaf3d4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.541729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 790/1555] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.543052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58c69-9cc7-49a3-97d9-20746acae15c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.543342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58c69-9cc7-49a3-97d9-20746acae15c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.543632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58c69-9cc7-49a3-97d9-20746acae15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.545365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10302d5-9ede-4e19-8698-4773caa5a838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.546093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10302d5-9ede-4e19-8698-4773caa5a838 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.546999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10302d5-9ede-4e19-8698-4773caa5a838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.547281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10302d5-9ede-4e19-8698-4773caa5a838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.556368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10302d5-9ede-4e19-8698-4773caa5a838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.557805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10302d5-9ede-4e19-8698-4773caa5a838 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.564376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-65e58c69-9cc7-49a3-97d9-20746acae15c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.565557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-65e58c69-9cc7-49a3-97d9-20746acae15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.568584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 766/1556] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:16.569643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449928-d2c1-4e90-bd88-db2e8a159ab2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.570018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449928-d2c1-4e90-bd88-db2e8a159ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.570300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449928-d2c1-4e90-bd88-db2e8a159ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.574274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 791/1557] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.575127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58c69-9cc7-49a3-97d9-20746acae15c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.580703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:16.586977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58c69-9cc7-49a3-97d9-20746acae15c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.595841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967f71-618d-4e49-8c7f-60e63d011562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.596601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967f71-618d-4e49-8c7f-60e63d011562 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.596887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967f71-618d-4e49-8c7f-60e63d011562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.597164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967f71-618d-4e49-8c7f-60e63d011562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.598127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967f71-618d-4e49-8c7f-60e63d011562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.598270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a3449928-d2c1-4e90-bd88-db2e8a159ab2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.598999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-ab967f71-618d-4e49-8c7f-60e63d011562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:38:16.598999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:38:16.598999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:38:16.599706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a3449928-d2c1-4e90-bd88-db2e8a159ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.600383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967f71-618d-4e49-8c7f-60e63d011562 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.611553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 767/1558] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.616804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6f938-7605-4632-8054-6025197e1451 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.617098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6f938-7605-4632-8054-6025197e1451 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.617427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6f938-7605-4632-8054-6025197e1451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.641027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 792/1559] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:16.641027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b148b-8a01-4552-969c-a43749d568d9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.641027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b148b-8a01-4552-969c-a43749d568d9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.641027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b148b-8a01-4552-969c-a43749d568d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.641466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1fc6f938-7605-4632-8054-6025197e1451 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.642775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1fc6f938-7605-4632-8054-6025197e1451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.662640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c64b148b-8a01-4552-969c-a43749d568d9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.663919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c64b148b-8a01-4552-969c-a43749d568d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.672452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:16.719060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 768/1560] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.720356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e56ee-292f-41b5-af4e-6d3d1c59908e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.720746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e56ee-292f-41b5-af4e-6d3d1c59908e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.721128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e56ee-292f-41b5-af4e-6d3d1c59908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.737011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 793/1561] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.741718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b148b-8a01-4552-969c-a43749d568d9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.742679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-990e56ee-292f-41b5-af4e-6d3d1c59908e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.744116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-990e56ee-292f-41b5-af4e-6d3d1c59908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.754550 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b148b-8a01-4552-969c-a43749d568d9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.755133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 769/1562] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.756574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b9a2-b28b-401f-9655-0d76b57e9c09 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.756866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b9a2-b28b-401f-9655-0d76b57e9c09 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.757139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956b9a2-b28b-401f-9655-0d76b57e9c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.772027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053e3fe-0ac2-42a6-8735-2893dda04b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.772719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e3fe-0ac2-42a6-8735-2893dda04b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.773005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e3fe-0ac2-42a6-8735-2893dda04b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.773320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053e3fe-0ac2-42a6-8735-2893dda04b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.774133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e3fe-0ac2-42a6-8735-2893dda04b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:16.774338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e3fe-0ac2-42a6-8735-2893dda04b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.776174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053e3fe-0ac2-42a6-8735-2893dda04b60 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.785705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2956b9a2-b28b-401f-9655-0d76b57e9c09 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.787381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2956b9a2-b28b-401f-9655-0d76b57e9c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.793232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 794/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:16.794725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb007ac-1302-4af2-a810-a26e47d1faf2 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.795074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb007ac-1302-4af2-a810-a26e47d1faf2 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.795359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb007ac-1302-4af2-a810-a26e47d1faf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.798532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 770/1564] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.802934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b9a2-b28b-401f-9655-0d76b57e9c09 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.812938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956b9a2-b28b-401f-9655-0d76b57e9c09 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.817595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.818205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.818486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.818659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-9bb007ac-1302-4af2-a810-a26e47d1faf2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.818782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.819383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.819921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9bb007ac-1302-4af2-a810-a26e47d1faf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.820441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:38:16.820441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 05 10:38:16.820441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: Sep 05 10:38:16.821665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.831189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 795/1565] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.832143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb007ac-1302-4af2-a810-a26e47d1faf2 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.844517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb007ac-1302-4af2-a810-a26e47d1faf2 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.848029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 771/1566] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:16.848866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.852600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab8f0-4024-4b09-89ab-36deb1084696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.853163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab8f0-4024-4b09-89ab-36deb1084696 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.853491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab8f0-4024-4b09-89ab-36deb1084696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.853792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab8f0-4024-4b09-89ab-36deb1084696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.854486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab8f0-4024-4b09-89ab-36deb1084696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:16.854795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab8f0-4024-4b09-89ab-36deb1084696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.856492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab8f0-4024-4b09-89ab-36deb1084696 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.864166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ecabd-c9ed-45a5-9c57-df85cd2ee780 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.870817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.870969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 796/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:16.871313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.871635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.871753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb539c80-0ff3-4fdc-823e-e6b16dceb833 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.871972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.872084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb539c80-0ff3-4fdc-823e-e6b16dceb833 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.872300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb539c80-0ff3-4fdc-823e-e6b16dceb833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.872564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:16.872867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.874083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:38:16.874083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 05 10:38:16.874083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: Sep 05 10:38:16.875024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.891758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 772/1568] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:16.892720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.897025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-eb539c80-0ff3-4fdc-823e-e6b16dceb833 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:16.898746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-eb539c80-0ff3-4fdc-823e-e6b16dceb833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:16.903795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d8de0-4cbf-4401-9b65-cadc36a99fb7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.907829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 797/1569] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:16.908684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb539c80-0ff3-4fdc-823e-e6b16dceb833 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.914038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.915257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.915545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.915856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.916492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.918400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb539c80-0ff3-4fdc-823e-e6b16dceb833 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:16.918547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.923902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:16.925134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:16.925447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:16.925727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:16.926386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:16.926702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:16.928430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:16.945386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 798/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:16.946291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.949693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 773/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:16.950514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:16.963751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf061438-d273-4e62-b14a-75b05ea299e9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.031740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46be0a9-dcb1-42c0-9d3d-31d5cc541abb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.034612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.035350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.035658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.035946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.036829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:17.037582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.038986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.039241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.039982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.040488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.041137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.042898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.045712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.062323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 799/1572] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:17.062323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.066781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 774/1573] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:17.068113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c0a6e-88e9-4244-b8cc-c5ec244147b9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.070988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.074145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.074897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.075645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.075645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.076402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.079298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.082156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119111d-dc69-4eeb-91a7-7669e475ca8a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.087077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.087765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.088138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.088318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.089004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.091033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.111917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:17.124086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 775/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.124086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.125353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 800/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.126061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.175144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:17.201430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0aa52-675b-4cb8-9d76-b1c60bb0fe8c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.203369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795945f-8618-4d13-b92d-2d0593f9082d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.207674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.208297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.208434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.208532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.208781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.208905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.209121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.209397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.209509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:17.209716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.210032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.211383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.212001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.224162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 776/1576] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:17.224960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.242160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a2cd4-42dd-4f1d-8ba9-33c6839a41de admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.246783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.247388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.247702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.247977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.248569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 801/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.248702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.249984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.251857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.282705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 777/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.283841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.297165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc81b-88c3-46d9-9c09-b7dcc3afe167 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.334670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adfa42-4481-4829-878c-862b793c5a9f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.358206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.359443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.359996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.360563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.361068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.371691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.372315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.372589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.372856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.373335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.373532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.375716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.388719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 778/1579] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:17.389692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.402970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bc66-b762-4d5c-aa2b-d8a039995989 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.409551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.410172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.410530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.410803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.411544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.413896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.424623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 802/1580] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.424623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.443350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 779/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.444262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.457755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679574e-bc99-49a3-821f-53c4aa886290 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.560395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbca50-c60e-40ab-9365-398b31e1ea36 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.570358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.571172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.573419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.573419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.573659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.573792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.573889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.574058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.574341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.574988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.576437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.576956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.603675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:17.611978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 803/1582] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.614686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 780/1583] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.616309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.616898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.640059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941bb72-46b1-4812-88b5-164177d026c3 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.665915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:17.753135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.753135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.753555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.753555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.754535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.757620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.758343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1188-708a-445d-82c3-17b17e533626 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.768781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.772138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.772521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.772738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.774469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.779487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.790770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 804/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.797711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.797917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 781/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:17.798791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.811018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6b8dc-4fce-437f-a6ec-37b410bbdb1c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.817350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.817745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.818003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.818266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] PATH_INFO: `/v3/projects/55e8d6fdef6444769c7c768a56d89526/users/c4ba7bc355ce43aca81631361028c7d4/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.829465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6cb5a-bb09-401a-989f-b04d95b2563d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.835904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.836676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.837656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.838094 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.839409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.841631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.852438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e8d6fdef6444769c7c768a56d89526, user_id=c4ba7bc355ce43aca81631361028c7d4, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.855147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.876325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 805/1586] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:17 2022] PUT /identity/v3/projects/55e8d6fdef6444769c7c768a56d89526/users/c4ba7bc355ce43aca81631361028c7d4/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:17.877833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.881220 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 782/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:17 2022] POST /identity/v3/users => generated 283 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:17.883552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:17.894866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b64ee-724f-468f-95f8-7cef27db26fc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.980919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.981857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.982369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.982882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:17.984711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:17.986975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:17.990142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e310e5-46c4-4d13-87df-484b44be7ff1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:17.997507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:17.998176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:17.998460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:17.998737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.002113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 783/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.003407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.011406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.013169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.016329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449e544-3385-407f-9c7f-da7a892d583e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.022071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.023035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.023856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.024479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.027629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.030885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.042816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 806/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.050757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.069598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe33e7-e835-4ea1-8c4b-2a24df585f62 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.075222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 784/1590] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:18 2022] POST /identity/v3/users => generated 303 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:18.076447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.078586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.079163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.079459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.079761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.080419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.082547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.090534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809967b-2cf2-41b1-b4e2-f54bef854ecd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.098929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6d53d-239d-4e22-ac06-037cae1185b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.099561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 807/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.099869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d53d-239d-4e22-ac06-037cae1185b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.100191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d53d-239d-4e22-ac06-037cae1185b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.100499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d53d-239d-4e22-ac06-037cae1185b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.100617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.101166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6d53d-239d-4e22-ac06-037cae1185b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.103084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6d53d-239d-4e22-ac06-037cae1185b7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.114863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b598f5-846a-4305-92c4-9c5dae43bcfa admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.122253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.122253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.122253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.122253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.124941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.125557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.129564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 785/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.132407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628135-b82e-471a-a36e-23ac2f4804c6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.132702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628135-b82e-471a-a36e-23ac2f4804c6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.132986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628135-b82e-471a-a36e-23ac2f4804c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.138906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 808/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.140617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.152486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19120eee-f68b-48a0-9e59-6cb5ee640bbf admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.159768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.160746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.161117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.161667 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.162513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.165035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.180009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 809/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.180888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.184255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-91628135-b82e-471a-a36e-23ac2f4804c6 None None] MFA Rules not processed for user `c4ba7bc355ce43aca81631361028c7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:18.186936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-91628135-b82e-471a-a36e-23ac2f4804c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:18.194468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4f66b-4bec-4ced-ae6e-6d2e3feef99c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.204045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.205018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.205467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.206273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.207210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.209558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.223583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 810/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.228176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.247443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37ad3-5b73-4aa1-8c5e-ab0c3cf81ceb admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.253180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.253865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.254394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.254672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.255323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.257030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.269775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 811/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.273640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.284432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c8edb-4b74-4086-bf4e-b931b5b0176e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.289486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.290105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.290392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.290673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.291328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.292999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.294189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:18.294673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:18.306885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 812/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.307841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.317897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 786/1598] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:18.319089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628135-b82e-471a-a36e-23ac2f4804c6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.320775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db28843-73a5-48f3-9d59-a105efe80238 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.326731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.327636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.327951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.328226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] PATH_INFO: `/v3/projects/6f542e3a21ac478ea043ece272fee09d/users/8d6bf797898240d8b9cdc3007994b314/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.337262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628135-b82e-471a-a36e-23ac2f4804c6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.344307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.345213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.345507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.345771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.347106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.349003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.350348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f542e3a21ac478ea043ece272fee09d, user_id=8d6bf797898240d8b9cdc3007994b314, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.353834 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.375551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 813/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:18 2022] PUT /identity/v3/projects/6f542e3a21ac478ea043ece272fee09d/users/8d6bf797898240d8b9cdc3007994b314/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:18.376505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.376764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 787/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.377795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.391682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d834d4-21af-419a-bbbb-9715b87e601b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.522824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a87d1-ccac-4e76-ad54-75fb366d1e1b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.522824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.522824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.522824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.531072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] PATH_INFO: `/v3/projects/40facf3616c64b52a05029afce9e58a9/users/df657ef737f643afa1c301d822fbcc4c/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.531682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.531682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.531682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.531682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] PATH_INFO: `/v3/projects/18abe1faae844933855e27f18d0e2cee/users/c2632b005b784efc8fcbe90cb7376529/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.532221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40facf3616c64b52a05029afce9e58a9, user_id=df657ef737f643afa1c301d822fbcc4c, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.532221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.532432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18abe1faae844933855e27f18d0e2cee, user_id=c2632b005b784efc8fcbe90cb7376529, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.532432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.542187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 788/1601] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:18 2022] PUT /identity/v3/projects/18abe1faae844933855e27f18d0e2cee/users/c2632b005b784efc8fcbe90cb7376529/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:18.543475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.548409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 814/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:18 2022] PUT /identity/v3/projects/40facf3616c64b52a05029afce9e58a9/users/df657ef737f643afa1c301d822fbcc4c/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:18.549061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.644324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca988ec-d140-45fd-b978-fdd46441c115 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.655280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff73520-cffe-48a9-833d-045bc0cb378f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.668221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b227e71-013d-4c41-9692-beb377507092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.669101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227e71-013d-4c41-9692-beb377507092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.669442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227e71-013d-4c41-9692-beb377507092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.669781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227e71-013d-4c41-9692-beb377507092 admin admin] PATH_INFO: `/v3/projects/b72375e5c57d48069779914aad2a8db7/users/a0cb2ecdde264e8f863d6f8f024371af/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.693262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b227e71-013d-4c41-9692-beb377507092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72375e5c57d48069779914aad2a8db7, user_id=a0cb2ecdde264e8f863d6f8f024371af, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.696384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b227e71-013d-4c41-9692-beb377507092 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.710337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddaca0-7e5e-4bec-9914-f80621c1d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.710935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddaca0-7e5e-4bec-9914-f80621c1d483 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.711159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddaca0-7e5e-4bec-9914-f80621c1d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.711438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddaca0-7e5e-4bec-9914-f80621c1d483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.712205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddaca0-7e5e-4bec-9914-f80621c1d483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.712368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 815/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:18 2022] PUT /identity/v3/projects/b72375e5c57d48069779914aad2a8db7/users/a0cb2ecdde264e8f863d6f8f024371af/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:18.713766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acb628-64e5-47c2-a9e6-06cf04dd1648 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.714057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acb628-64e5-47c2-a9e6-06cf04dd1648 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.714336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acb628-64e5-47c2-a9e6-06cf04dd1648 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.716029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 816/1604] 10.222.0.16 () {54 vars in 962 bytes} [Mon Sep 5 10:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:18.716728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acb628-64e5-47c2-a9e6-06cf04dd1648 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:18.717624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddaca0-7e5e-4bec-9914-f80621c1d483 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.728783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 789/1605] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:18.730161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8fd41-98e2-4571-85fb-af089f2cb18d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.730457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8fd41-98e2-4571-85fb-af089f2cb18d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.730734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8fd41-98e2-4571-85fb-af089f2cb18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.757202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:18.767483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3ed8fd41-98e2-4571-85fb-af089f2cb18d None None] MFA Rules not processed for user `8d6bf797898240d8b9cdc3007994b314`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:18.768948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ed8fd41-98e2-4571-85fb-af089f2cb18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:18.774852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:18.808137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acb628-64e5-47c2-a9e6-06cf04dd1648 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:18.816219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb5f5-7531-4899-b303-aff94531d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:18.817067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb5f5-7531-4899-b303-aff94531d328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.817354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb5f5-7531-4899-b303-aff94531d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.817661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb5f5-7531-4899-b303-aff94531d328 admin admin] PATH_INFO: `/v3/projects/095379a82f22428b8613e6aad211bf74/users/7fc9504b7e2f4a8e8c0d172896767031/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.837543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb5f5-7531-4899-b303-aff94531d328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095379a82f22428b8613e6aad211bf74, user_id=7fc9504b7e2f4a8e8c0d172896767031, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:18.839963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb5f5-7531-4899-b303-aff94531d328 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:18.871946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 790/1606] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:18.872484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 817/1607] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:18 2022] PUT /identity/v3/projects/095379a82f22428b8613e6aad211bf74/users/7fc9504b7e2f4a8e8c0d172896767031/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:18.872603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a05ab-fdc7-4320-8aab-02bd3bd28587 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.872603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a05ab-fdc7-4320-8aab-02bd3bd28587 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.872603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a05ab-fdc7-4320-8aab-02bd3bd28587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.872849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233c9b-38b4-4297-85ca-9a5cf88d9de4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.872849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233c9b-38b4-4297-85ca-9a5cf88d9de4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.872849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233c9b-38b4-4297-85ca-9a5cf88d9de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:18.897156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b33a05ab-fdc7-4320-8aab-02bd3bd28587 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:18.898694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b33a05ab-fdc7-4320-8aab-02bd3bd28587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:18.915869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-4b233c9b-38b4-4297-85ca-9a5cf88d9de4 None None] MFA Rules not processed for user `df657ef737f643afa1c301d822fbcc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:18.917828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4b233c9b-38b4-4297-85ca-9a5cf88d9de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:18.979530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 791/1608] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:18.980900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10427d-8ef8-4272-81f8-3b46a0f8bd13 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:18.981262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10427d-8ef8-4272-81f8-3b46a0f8bd13 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:18.981609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10427d-8ef8-4272-81f8-3b46a0f8bd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.003689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ab10427d-8ef8-4272-81f8-3b46a0f8bd13 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:19.005948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab10427d-8ef8-4272-81f8-3b46a0f8bd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:19.011501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 818/1609] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:19.012754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480eaab-dc29-4020-98bf-871f3a9d258d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.013138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480eaab-dc29-4020-98bf-871f3a9d258d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.013528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480eaab-dc29-4020-98bf-871f3a9d258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.024575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 792/1610] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:19.024575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10427d-8ef8-4272-81f8-3b46a0f8bd13 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.037342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10427d-8ef8-4272-81f8-3b46a0f8bd13 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.044263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9672f-5a98-456e-ae79-71c976cb25ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.045083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9672f-5a98-456e-ae79-71c976cb25ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.045373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9672f-5a98-456e-ae79-71c976cb25ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.045848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9672f-5a98-456e-ae79-71c976cb25ce admin admin] PATH_INFO: `/v3/projects/d1bd2b2ca23144bebe124f32f4990ab9/users/8f1206a96df24252b77558c75bd118a0/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.064305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9672f-5a98-456e-ae79-71c976cb25ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bd2b2ca23144bebe124f32f4990ab9, user_id=8f1206a96df24252b77558c75bd118a0, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.067352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9672f-5a98-456e-ae79-71c976cb25ce admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.069032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2480eaab-dc29-4020-98bf-871f3a9d258d None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:19.070413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2480eaab-dc29-4020-98bf-871f3a9d258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:19.087687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 793/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:19 2022] PUT /identity/v3/projects/d1bd2b2ca23144bebe124f32f4990ab9/users/8f1206a96df24252b77558c75bd118a0/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:19.090496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dd322-9de9-4728-949c-8dda9f7e795e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.095171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dd322-9de9-4728-949c-8dda9f7e795e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.095611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dd322-9de9-4728-949c-8dda9f7e795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.141779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e66dd322-9de9-4728-949c-8dda9f7e795e None None] MFA Rules not processed for user `7fc9504b7e2f4a8e8c0d172896767031`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:19.143090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e66dd322-9de9-4728-949c-8dda9f7e795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:19.197350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 819/1612] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Sep 5 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:19.199039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6946c-d3ee-4ab0-8872-c31f8268a158 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.199332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6946c-d3ee-4ab0-8872-c31f8268a158 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.199749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6946c-d3ee-4ab0-8872-c31f8268a158 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.201361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 820/1613] 10.222.0.16 () {54 vars in 962 bytes} [Mon Sep 5 10:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:19.202050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6946c-d3ee-4ab0-8872-c31f8268a158 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.204362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0db6946c-d3ee-4ab0-8872-c31f8268a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:19.250785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:19.261477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 794/1614] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:19.262590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dd322-9de9-4728-949c-8dda9f7e795e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.273054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:19.332380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6946c-d3ee-4ab0-8872-c31f8268a158 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.339727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee104db3-1352-46ea-9011-a10261b12212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.343733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee104db3-1352-46ea-9011-a10261b12212 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.344250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee104db3-1352-46ea-9011-a10261b12212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.344536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee104db3-1352-46ea-9011-a10261b12212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.353861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dd322-9de9-4728-949c-8dda9f7e795e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.358125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.358626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.359114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.359419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.447495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.457066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee104db3-1352-46ea-9011-a10261b12212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.459752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.460017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee104db3-1352-46ea-9011-a10261b12212 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.470824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 795/1615] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:19.471874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.473154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 821/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:19.474659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1eaf-84fc-41b4-be55-f4404dafea60 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.475130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1eaf-84fc-41b4-be55-f4404dafea60 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.475419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1eaf-84fc-41b4-be55-f4404dafea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.482033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5bc83-39f5-41af-9181-8081a3e00b23 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.487209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c6c40-4370-480f-b068-71477877661d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.487951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c6c40-4370-480f-b068-71477877661d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.488301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c6c40-4370-480f-b068-71477877661d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.488792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c6c40-4370-480f-b068-71477877661d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.502967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c6c40-4370-480f-b068-71477877661d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.505191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c6c40-4370-480f-b068-71477877661d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.517264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f5fa1eaf-84fc-41b4-be55-f4404dafea60 None None] MFA Rules not processed for user `8f1206a96df24252b77558c75bd118a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:19.517507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 796/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:19.518512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c6c40-4370-480f-b068-71477877661d service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.518622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f5fa1eaf-84fc-41b4-be55-f4404dafea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:19.641467 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c6c40-4370-480f-b068-71477877661d service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.660736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.661721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.662258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.665121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.694586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 822/1618] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:19.696087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac7b-7172-4226-a853-681f8f35b6be None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.696439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac7b-7172-4226-a853-681f8f35b6be None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.696799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac7b-7172-4226-a853-681f8f35b6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.768516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f353ac7b-7172-4226-a853-681f8f35b6be None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:19.769771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f353ac7b-7172-4226-a853-681f8f35b6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:19.775798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:19.807192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 823/1619] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Sep 5 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:19.808198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ac7b-7172-4226-a853-681f8f35b6be None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.832259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ac7b-7172-4226-a853-681f8f35b6be None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.836776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.839468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.847250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.847923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.848205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.848481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.849392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.851915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.864322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 797/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:19.865177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.887673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587675-362d-4a38-be8a-fc4aa01a6264 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:19.897892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:19.898519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:19.898816 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:19.899076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:19.899743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:19.903895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:19.912661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 824/1621] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:19 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:19.913532 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:19.968625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 798/1622] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:19 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:19.968625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.007871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:20.065397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ede7f-4117-46b6-8b82-4e5ed7136fbf admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.111260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bcf43-f706-4129-bf0d-b8a51d04aed7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.130959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.131617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.131903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.132182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.139384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.142558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.215536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 799/1623] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:19 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:20.216518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.246313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e8a9d-8cde-40f8-9002-711a0af82659 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.259829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.260565 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.260770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.261002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.262768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.271010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.271010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.271010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.271010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.271440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.334896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 800/1624] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:20 2022] POST /identity/v3/users => generated 308 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:20.334896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.358151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e327-7bb0-4e6f-86be-369872204a54 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.372132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.373228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.373674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.376634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.377793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.383701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.400042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.403101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.411402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 801/1625] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:20.419383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.431076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 825/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:20.434063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.440381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a9b4-b942-4e87-a501-caa240dee65c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.453663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.454819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.455208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.455613 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.456566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.459217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.462930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff911d-c79c-4001-aafc-f24a3461dd30 service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.475257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544a6a-d180-4430-bbe8-de584f0f9172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.477926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544a6a-d180-4430-bbe8-de584f0f9172 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.479186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544a6a-d180-4430-bbe8-de584f0f9172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.479715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544a6a-d180-4430-bbe8-de584f0f9172 admin admin] PATH_INFO: `/v3/projects/a1057f4d6f9c48cda4b15b62960eecfc/users/563c3bf7a09749b585c350accd38f590/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.494301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 802/1627] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:20.495274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.519213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e70f7-1ea7-43ee-9890-35ad02bd4882 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.520579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544a6a-d180-4430-bbe8-de584f0f9172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1057f4d6f9c48cda4b15b62960eecfc, user_id=563c3bf7a09749b585c350accd38f590, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.527260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721349f1-6bd6-45cd-8e8c-41e0053225ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.528477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544a6a-d180-4430-bbe8-de584f0f9172 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.528624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721349f1-6bd6-45cd-8e8c-41e0053225ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.528910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721349f1-6bd6-45cd-8e8c-41e0053225ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.529210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721349f1-6bd6-45cd-8e8c-41e0053225ff admin admin] PATH_INFO: `/v3/projects/36365588119040efb3c935f4bea9f6c6/users/ab11918dbd8b494db13cae1b99d08257/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.574539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 826/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:20 2022] PUT /identity/v3/projects/a1057f4d6f9c48cda4b15b62960eecfc/users/563c3bf7a09749b585c350accd38f590/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:20.577169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72842e90-cba1-4dcc-9a2b-151ec95b06c4 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.577828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72842e90-cba1-4dcc-9a2b-151ec95b06c4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.578468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72842e90-cba1-4dcc-9a2b-151ec95b06c4 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.580367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 827/1629] 10.222.0.16 () {54 vars in 912 bytes} [Mon Sep 5 10:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:20.581041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721349f1-6bd6-45cd-8e8c-41e0053225ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=36365588119040efb3c935f4bea9f6c6, user_id=ab11918dbd8b494db13cae1b99d08257, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.583895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721349f1-6bd6-45cd-8e8c-41e0053225ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.585610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72842e90-cba1-4dcc-9a2b-151ec95b06c4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.610403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 803/1630] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:20 2022] PUT /identity/v3/projects/36365588119040efb3c935f4bea9f6c6/users/ab11918dbd8b494db13cae1b99d08257/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:20.614438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0240ee-240d-4e32-851e-b94a8ab6b5bf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.614738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0240ee-240d-4e32-851e-b94a8ab6b5bf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.615653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0240ee-240d-4e32-851e-b94a8ab6b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.662243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4b0240ee-240d-4e32-851e-b94a8ab6b5bf None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:20.663646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4b0240ee-240d-4e32-851e-b94a8ab6b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:20.734577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:20.744730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:20.757608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72842e90-cba1-4dcc-9a2b-151ec95b06c4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.837745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 804/1631] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:20.845147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0240ee-240d-4e32-851e-b94a8ab6b5bf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.845322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.846244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.846596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.847071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.848919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.851042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.866144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 828/1632] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:20.867378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.873473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0240ee-240d-4e32-851e-b94a8ab6b5bf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.890133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.890792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.891062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.891365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.892033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:20.893886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:20.951655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 805/1633] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:20.958978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:20.976198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7320c2-8b68-4ad4-b258-5a1b0eb39848 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.980970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:20.981537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:20.981820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:20.982099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:20.993091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862465-e687-4e89-8681-614541b116e7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:20.999003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.002497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:21.013401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af087b7-50e7-4ff6-962d-386a1fcd935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.017421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af087b7-50e7-4ff6-962d-386a1fcd935e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.017586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af087b7-50e7-4ff6-962d-386a1fcd935e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.017833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af087b7-50e7-4ff6-962d-386a1fcd935e admin admin] PATH_INFO: `/v3/projects/a1057f4d6f9c48cda4b15b62960eecfc/users/563c3bf7a09749b585c350accd38f590/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.023183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af087b7-50e7-4ff6-962d-386a1fcd935e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1057f4d6f9c48cda4b15b62960eecfc, user_id=563c3bf7a09749b585c350accd38f590, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.027042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af087b7-50e7-4ff6-962d-386a1fcd935e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:21.041275 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 829/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:21.051893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:21.065339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 806/1635] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:20 2022] PUT /identity/v3/projects/a1057f4d6f9c48cda4b15b62960eecfc/users/563c3bf7a09749b585c350accd38f590/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:21.067284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4d80e-c40a-4fd2-9b14-083d157c69d8 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.068078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4d80e-c40a-4fd2-9b14-083d157c69d8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.068078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4d80e-c40a-4fd2-9b14-083d157c69d8 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.078929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04696f0-7b7a-46a2-a9ab-3c97bcd10c01 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:21.079580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 807/1636] 10.222.0.16 () {54 vars in 912 bytes} [Mon Sep 5 10:38:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:21.081084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7384a9-572e-484f-8e6e-80e6cdb469eb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.081387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7384a9-572e-484f-8e6e-80e6cdb469eb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.081640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7384a9-572e-484f-8e6e-80e6cdb469eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.127743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cd7384a9-572e-484f-8e6e-80e6cdb469eb None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:21.132010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cd7384a9-572e-484f-8e6e-80e6cdb469eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:21.215580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f9c7d-79b8-444c-9d31-053297ebde46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.216739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9c7d-79b8-444c-9d31-053297ebde46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.219486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9c7d-79b8-444c-9d31-053297ebde46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.220058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f9c7d-79b8-444c-9d31-053297ebde46 admin admin] PATH_INFO: `/v3/projects/36365588119040efb3c935f4bea9f6c6/users/ab11918dbd8b494db13cae1b99d08257/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.222623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f9c7d-79b8-444c-9d31-053297ebde46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36365588119040efb3c935f4bea9f6c6, user_id=ab11918dbd8b494db13cae1b99d08257, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.227347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f9c7d-79b8-444c-9d31-053297ebde46 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:21.255027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 830/1637] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:21 2022] PUT /identity/v3/projects/36365588119040efb3c935f4bea9f6c6/users/ab11918dbd8b494db13cae1b99d08257/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:21.256751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef19ca-b7bc-4eca-a706-a4e6ee953f3a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.257010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef19ca-b7bc-4eca-a706-a4e6ee953f3a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.259410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef19ca-b7bc-4eca-a706-a4e6ee953f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.316688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e2ef19ca-b7bc-4eca-a706-a4e6ee953f3a None None] MFA Rules not processed for user `563c3bf7a09749b585c350accd38f590`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:21.319405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e2ef19ca-b7bc-4eca-a706-a4e6ee953f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:21.326371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 808/1638] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:21.328338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8d3f-eba7-409b-acdd-c13a14ec80be None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.328629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8d3f-eba7-409b-acdd-c13a14ec80be None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.328966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8d3f-eba7-409b-acdd-c13a14ec80be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.369868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:21.438965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7c1d8d3f-eba7-409b-acdd-c13a14ec80be None None] MFA Rules not processed for user `ab11918dbd8b494db13cae1b99d08257`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:21.440470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7c1d8d3f-eba7-409b-acdd-c13a14ec80be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:21.501420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 831/1639] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:21.504970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef19ca-b7bc-4eca-a706-a4e6ee953f3a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:21.616057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 809/1640] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:21.616057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8d3f-eba7-409b-acdd-c13a14ec80be None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:21.654954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:21.657432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef19ca-b7bc-4eca-a706-a4e6ee953f3a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:21.666243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.668674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.668971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.669262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.693190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8d3f-eba7-409b-acdd-c13a14ec80be None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:21.701834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.703256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.703553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.706519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.731200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.735712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:21.779681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 810/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:21.782250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.784710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:21.818033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 832/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:21.888721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:21.898829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267f8dd-a8f9-4221-b2dc-a19f0c495fa4 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:21.936109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:21.937356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:21.937647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:21.937931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:21.975676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:21.979495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:22.011033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 811/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:21 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:38:22.278834 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:22.291718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7d91c-49b8-416d-9497-61e03f53c174 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:22.329377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97664c-64c3-472b-a47c-3ddc78bbb531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:22.332562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97664c-64c3-472b-a47c-3ddc78bbb531 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:22.332839 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97664c-64c3-472b-a47c-3ddc78bbb531 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:22.333131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97664c-64c3-472b-a47c-3ddc78bbb531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:22.441255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:22.451881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97664c-64c3-472b-a47c-3ddc78bbb531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:22.457247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97664c-64c3-472b-a47c-3ddc78bbb531 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:22.486717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 833/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:22.547887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:22.724940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd699020-46fe-4c78-b2ed-7479a8a723a0 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:22.744987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:22.745879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:22.748512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:22.751285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] PATH_INFO: `/v3/users/8d6bf797898240d8b9cdc3007994b314` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:22.757365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6bf797898240d8b9cdc3007994b314)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:22.764307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:22.885235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6bf797898240d8b9cdc3007994b314'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:22.886376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6bf797898240d8b9cdc3007994b314'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:22.889374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6bf797898240d8b9cdc3007994b314'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:22.905499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6bf797898240d8b9cdc3007994b314'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:22.929692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6bf797898240d8b9cdc3007994b314'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:22.967939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 812/1645] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:22 2022] DELETE /identity/v3/users/8d6bf797898240d8b9cdc3007994b314 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:22.972686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f123-a346-421d-821a-24ddead3751e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:22.973127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f123-a346-421d-821a-24ddead3751e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:22.974051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f123-a346-421d-821a-24ddead3751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:23.001748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3303f123-a346-421d-821a-24ddead3751e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:23.003462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3303f123-a346-421d-821a-24ddead3751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:23.176622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 834/1646] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:23.215698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303f123-a346-421d-821a-24ddead3751e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:23.216667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:23.219900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3303f123-a346-421d-821a-24ddead3751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:23.220980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:23.259994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303f123-a346-421d-821a-24ddead3751e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:23.285977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:23.286651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:23.286931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:23.292089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] PATH_INFO: `/v3/users/8f1206a96df24252b77558c75bd118a0` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:23.299566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1206a96df24252b77558c75bd118a0)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:23.304072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: WARNING py.warnings [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:38:23.304072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: warnings.warn(msg) Sep 05 10:38:23.304072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: Sep 05 10:38:23.309704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:23.380640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:23.460368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd4e64-4b3b-494a-80e6-4577db1a3cb8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:23.478538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fd0ce-ea80-4e66-9adc-91dcfc8f39ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:23.479182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fd0ce-ea80-4e66-9adc-91dcfc8f39ae service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:23.484549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fd0ce-ea80-4e66-9adc-91dcfc8f39ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:23.485687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fd0ce-ea80-4e66-9adc-91dcfc8f39ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:23.532435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fd0ce-ea80-4e66-9adc-91dcfc8f39ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:23.537331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fd0ce-ea80-4e66-9adc-91dcfc8f39ae service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:23.558644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1206a96df24252b77558c75bd118a0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:23.560959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1206a96df24252b77558c75bd118a0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:23.574367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 813/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:23.633791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1206a96df24252b77558c75bd118a0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:23.653907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1206a96df24252b77558c75bd118a0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:23.657409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1206a96df24252b77558c75bd118a0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:23.703582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 835/1648] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:23 2022] DELETE /identity/v3/users/8f1206a96df24252b77558c75bd118a0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:23.708040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:23.708727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:23.709980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:23.762047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:23.766153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:23.952919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 814/1649] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:24.005391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:24.006622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:24.222456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35c5d1-bb45-4dc5-9830-5e7a4c936d3d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:24.228066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf74ad-96f7-4167-a5bd-a82a616f5fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:24.228816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf74ad-96f7-4167-a5bd-a82a616f5fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:24.228986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf74ad-96f7-4167-a5bd-a82a616f5fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:24.229264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf74ad-96f7-4167-a5bd-a82a616f5fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:24.251895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf74ad-96f7-4167-a5bd-a82a616f5fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:24.253653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf74ad-96f7-4167-a5bd-a82a616f5fc7 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:24.312013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 836/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:25.024994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:25.027784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:25.076211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f73da9-a282-468d-84e4-9c390ca2be85 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:25.100155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:25.102610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:25.105651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:25.110621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] PATH_INFO: `/v3/projects/6f542e3a21ac478ea043ece272fee09d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:25.116997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f542e3a21ac478ea043ece272fee09d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:25.119405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: WARNING py.warnings [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 10:38:25.119405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: warnings.warn(msg) Sep 05 10:38:25.119405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: Sep 05 10:38:25.128307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:25.322306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f542e3a21ac478ea043ece272fee09d', 'request_id': 'req-3f793214-dd86-4da1-ab8b-54259f2a42b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:25.367639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f542e3a21ac478ea043ece272fee09d', 'request_id': 'req-3f793214-dd86-4da1-ab8b-54259f2a42b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:25.383814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f542e3a21ac478ea043ece272fee09d', 'request_id': 'req-3f793214-dd86-4da1-ab8b-54259f2a42b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:25.423306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] The token cache is being invalidate because project 6f542e3a21ac478ea043ece272fee09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:25.424014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:25.425063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f793214-dd86-4da1-ab8b-54259f2a42b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:25.429321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 815/1651] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:25 2022] DELETE /identity/v3/projects/6f542e3a21ac478ea043ece272fee09d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:25.434265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7f76-5c5f-4574-981d-6a43608c6596 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:25.435033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7f76-5c5f-4574-981d-6a43608c6596 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:25.438538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7f76-5c5f-4574-981d-6a43608c6596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:25.519315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-837d7f76-5c5f-4574-981d-6a43608c6596 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:25.519315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-837d7f76-5c5f-4574-981d-6a43608c6596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:25.541451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:25.701535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 837/1652] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:25.710153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22523cb-6487-4cca-8f88-5acf88532f91 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:25.710574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22523cb-6487-4cca-8f88-5acf88532f91 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:25.710963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22523cb-6487-4cca-8f88-5acf88532f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:25.755027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c22523cb-6487-4cca-8f88-5acf88532f91 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:25.756932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c22523cb-6487-4cca-8f88-5acf88532f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:25.777491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 816/1653] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:25.781812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7f76-5c5f-4574-981d-6a43608c6596 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:25.793967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7f76-5c5f-4574-981d-6a43608c6596 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:25.806504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:25.808020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:25.816193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:25.816319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:25.817207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:25.817595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:25.819774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:25.847669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 838/1654] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:25.851814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22523cb-6487-4cca-8f88-5acf88532f91 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:25.862671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22523cb-6487-4cca-8f88-5acf88532f91 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:25.877658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:25.878347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:25.880003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:25.881694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:25.882480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:25.891847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:25.985867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 817/1655] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:25 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:25.994220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:26.039655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628978-cc3e-4222-a539-4d127ff122d2 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:26.192232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:26.196756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:26.275835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:26.277262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:26.278117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:26.278690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:26.280688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:26.284871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:26.313255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:26.357453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 839/1656] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:25 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:26.358944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:26.397743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10874aaa-11a9-4883-83bf-c93554ab8958 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:26.426687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:26.427317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:26.427618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:26.427903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:26.433521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:26.441254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:26.442231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3d490-c36e-4cac-9b9b-4ddc42354cc7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:26.466528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:26.467198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:26.467483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:26.468364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] PATH_INFO: `/v3/projects/d1bd2b2ca23144bebe124f32f4990ab9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:26.473050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bd2b2ca23144bebe124f32f4990ab9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:26.475920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:26.486799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 840/1657] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:26.491825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:26.527114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027956de-c5b7-4844-9413-3058f18e0f61 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:26.541824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:26.544657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:26.545080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:26.546310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:26.546980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:26.552974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:26.580243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 841/1658] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:26.584735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:26.604847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bd2b2ca23144bebe124f32f4990ab9', 'request_id': 'req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:26.617149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8b21d-030c-4ac9-994c-8c88e801eaec admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:26.620760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bd2b2ca23144bebe124f32f4990ab9', 'request_id': 'req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:26.645045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bd2b2ca23144bebe124f32f4990ab9', 'request_id': 'req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:26.676269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] The token cache is being invalidate because project d1bd2b2ca23144bebe124f32f4990ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:26.676573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:26.677287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:26.679073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 818/1659] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:26 2022] DELETE /identity/v3/projects/d1bd2b2ca23144bebe124f32f4990ab9 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:26.684664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:26.689522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:26.800067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8f7e3-17fd-4ccc-a2ea-806282df940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:26.800788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8f7e3-17fd-4ccc-a2ea-806282df940f admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:26.809949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8f7e3-17fd-4ccc-a2ea-806282df940f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:26.810752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8f7e3-17fd-4ccc-a2ea-806282df940f admin admin] PATH_INFO: `/v3/projects/0fa9548987a6466ebdd4d9ea1e38eb06/users/3bc9d54584cb428db9c14cb273b267f9/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:26.837270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:26.851011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8f7e3-17fd-4ccc-a2ea-806282df940f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa9548987a6466ebdd4d9ea1e38eb06, user_id=3bc9d54584cb428db9c14cb273b267f9, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:26.856287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8f7e3-17fd-4ccc-a2ea-806282df940f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:26.880960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 842/1660] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:26 2022] PUT /identity/v3/projects/0fa9548987a6466ebdd4d9ea1e38eb06/users/3bc9d54584cb428db9c14cb273b267f9/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:26.894475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:26.894821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:26.895171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:26.936136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f667-e5d4-4e5f-8070-d9b1cc0834fe admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:26.953633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] MFA Rules not processed for user `3bc9d54584cb428db9c14cb273b267f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:26.956176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:27.090626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 843/1661] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:27.096367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:27.114444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:27.192226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:27.193061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:27.193915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:27.194398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] PATH_INFO: `/v3/users/ab11918dbd8b494db13cae1b99d08257` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:27.196293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab11918dbd8b494db13cae1b99d08257)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:27.200767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:27.221684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5262fe-c837-4cf1-a939-ca21d09e1b97 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:27.227713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:27.228542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:27.228826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:27.229104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:27.229883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:27.232338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:27.234213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:27.279989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 844/1662] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:27 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:27.286494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:27.372336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab11918dbd8b494db13cae1b99d08257'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:27.373489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab11918dbd8b494db13cae1b99d08257'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:27.374845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab11918dbd8b494db13cae1b99d08257'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:27.398295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab11918dbd8b494db13cae1b99d08257'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:27.457639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab11918dbd8b494db13cae1b99d08257'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:27.471552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f969427-f44d-4bcc-896d-d250754644fa admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:27.490845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:27.491479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:27.498327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:27.499541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 819/1663] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:26 2022] DELETE /identity/v3/users/ab11918dbd8b494db13cae1b99d08257 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:27.499772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:27.500442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:27.502919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:27.537944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:27.585658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 845/1664] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:27 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:27.589330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:27.591189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:27.678555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8c862-4309-4fde-9845-3e32b77577c4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:27.695107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:27.695107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:27.695107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:27.695107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:27.695369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:27.695369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:27.733046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 820/1665] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:27.737913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:27.761063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83c042-31c3-4ec7-8d61-7e63caf908bd admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:27.769329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:27.779545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:27.779963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:27.781391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] PATH_INFO: `/v3/projects/485a36656eeb4aeb8bddc32e6acf937e/users/90e15f92c289459facacd51f43572314/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:27.813273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=485a36656eeb4aeb8bddc32e6acf937e, user_id=90e15f92c289459facacd51f43572314, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:27.817902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:27.842471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 846/1666] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:27 2022] PUT /identity/v3/projects/485a36656eeb4aeb8bddc32e6acf937e/users/90e15f92c289459facacd51f43572314/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:27.847072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:27.888680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2f054-6fef-4570-8f1a-b34d3cff551e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:27.999032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d52e1-412c-4256-a2d4-21ff0bbf58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:27.999894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d52e1-412c-4256-a2d4-21ff0bbf58b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:28.000181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d52e1-412c-4256-a2d4-21ff0bbf58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:28.000460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d52e1-412c-4256-a2d4-21ff0bbf58b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:28.001291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d52e1-412c-4256-a2d4-21ff0bbf58b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:28.007485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d52e1-412c-4256-a2d4-21ff0bbf58b4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:28.041652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 821/1667] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:28.043572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:28.057851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71846cc-6a64-43ba-aa46-11b28971df9c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:28.075687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:28.076402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:28.076690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:28.076970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] PATH_INFO: `/v3/projects/485a36656eeb4aeb8bddc32e6acf937e/users/90e15f92c289459facacd51f43572314/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:28.079852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=485a36656eeb4aeb8bddc32e6acf937e, user_id=90e15f92c289459facacd51f43572314, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:28.082532 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:28.122047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 847/1668] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:28 2022] PUT /identity/v3/projects/485a36656eeb4aeb8bddc32e6acf937e/users/90e15f92c289459facacd51f43572314/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:28.127063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:28.127360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:28.127697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:28.323133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] MFA Rules not processed for user `90e15f92c289459facacd51f43572314`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:28.324441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:28.357366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:28.559298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 822/1669] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:28.617562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:28.619406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:28.626133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:28.627538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:28.793817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a3b5-64ea-4119-949a-cc6cd91aa375 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:28.805076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:28.806999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:28.807307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:28.807626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:28.829866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:28.831347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:28.851314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09b1e9-1bb9-4a44-b759-b6949f35a32b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:28.857468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:28.858178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:28.859148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:28.859846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] PATH_INFO: `/v3/users/c4ba7bc355ce43aca81631361028c7d4` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:28.862211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ba7bc355ce43aca81631361028c7d4)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:28.864422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:28.878802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 823/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:38:28.985126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ba7bc355ce43aca81631361028c7d4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:28.987241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ba7bc355ce43aca81631361028c7d4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.022117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ba7bc355ce43aca81631361028c7d4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.023154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:29.024725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.045397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ba7bc355ce43aca81631361028c7d4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.047072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ba7bc355ce43aca81631361028c7d4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.069258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590fd1-9db8-433d-bb2c-be02f3285af9 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:29.072736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 848/1671] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:28 2022] DELETE /identity/v3/users/c4ba7bc355ce43aca81631361028c7d4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:29.074282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:29.076117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.184497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:29.250275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:29.252382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.254461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.254576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] PATH_INFO: `/v3/projects/36365588119040efb3c935f4bea9f6c6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.257500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e13b19-0b54-4ef9-a4a0-78358cb939bc admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:29.258648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36365588119040efb3c935f4bea9f6c6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:29.261454 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:29.269208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263f24d-d8d9-4128-a0fe-bd66021022e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:29.270645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263f24d-d8d9-4128-a0fe-bd66021022e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.270929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263f24d-d8d9-4128-a0fe-bd66021022e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.271208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263f24d-d8d9-4128-a0fe-bd66021022e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.275561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9263f24d-d8d9-4128-a0fe-bd66021022e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.367076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36365588119040efb3c935f4bea9f6c6', 'request_id': 'req-a2447a5a-0211-4b81-8c61-ff290ff70159'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.368874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:29.380676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36365588119040efb3c935f4bea9f6c6', 'request_id': 'req-a2447a5a-0211-4b81-8c61-ff290ff70159'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.394671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36365588119040efb3c935f4bea9f6c6', 'request_id': 'req-a2447a5a-0211-4b81-8c61-ff290ff70159'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.411380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263f24d-d8d9-4128-a0fe-bd66021022e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:29.413099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263f24d-d8d9-4128-a0fe-bd66021022e7 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:29.418707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] The token cache is being invalidate because project 36365588119040efb3c935f4bea9f6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:29.418707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.419238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a2447a5a-0211-4b81-8c61-ff290ff70159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:29.421710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 824/1672] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:29 2022] DELETE /identity/v3/projects/36365588119040efb3c935f4bea9f6c6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:29.425818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042cd2-2c55-493b-bc38-2771d9e67400 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.426112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042cd2-2c55-493b-bc38-2771d9e67400 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.427780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042cd2-2c55-493b-bc38-2771d9e67400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.438066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 849/1673] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:29.440292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9631-349a-49a8-b662-07709df13dc3 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.440581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9631-349a-49a8-b662-07709df13dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.440861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9631-349a-49a8-b662-07709df13dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.470384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2d042cd2-2c55-493b-bc38-2771d9e67400 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:29.472429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d042cd2-2c55-493b-bc38-2771d9e67400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.502251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-67ec9631-349a-49a8-b662-07709df13dc3 None None] MFA Rules not processed for user `ee3a89d96fca43148c1d955f30ca9e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:29.505051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-67ec9631-349a-49a8-b662-07709df13dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.671839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 825/1674] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:29.672873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.672873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.672873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.717401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:29.718917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.721045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 850/1675] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:29.732426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241482-072d-436f-81dc-55062cd031eb None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.732863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241482-072d-436f-81dc-55062cd031eb None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.733152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241482-072d-436f-81dc-55062cd031eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.749809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 826/1676] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:29.753796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:29.757137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.774784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-94241482-072d-436f-81dc-55062cd031eb None None] MFA Rules not processed for user `ee3a89d96fca43148c1d955f30ca9e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:29.775881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-94241482-072d-436f-81dc-55062cd031eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.795801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 851/1677] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:29.797227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.797519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.797796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.831828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:29.833519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.845980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 852/1678] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:29.847045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:29.850243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:29.921570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33b373-9a22-440d-b8d3-3918de2afbfd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:29.926483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:29.927294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.927762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.928226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.943297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:29.945150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:29.958717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 827/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:29.959517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:29.975761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e94c62-6e02-417f-b192-91f60fd78401 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:29.989105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:29.990212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:29.990505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:29.992073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:29.993846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:29.995957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:30.002079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:30.010721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:30.020771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad333-b2eb-4f54-a82b-bf3cfcf55968 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:30.031846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 828/1680] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:30.036231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:30.046760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:30.047364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.047754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.048128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.081217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:30.082947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:30.083758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b98ef-6f84-4c8e-b40a-6d8aa4fdf56b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:30.103990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:30.104649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.104940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.105226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.105887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:30.110772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 853/1681] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:30.115621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:30.208670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 829/1682] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:30 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:38:30.212496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:30.237496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9270b2-3d88-4bc7-9ab3-1ea4bd277549 service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:30.400501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:30.404423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.404423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.404780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.406651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:30.409089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:30.446775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 854/1683] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:30 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:30.447248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:30.465717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4e3fa-587b-4ffd-b656-f7ac66d4d8c7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:30.482685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:30.483517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.483807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.484100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.485349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:30.486996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:30.503010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 830/1684] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:38:30.507584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:30.522106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b597c8-3cd2-40aa-aec4-f5c6f84b55e8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:30.531846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee70e09-5d8c-47f6-8014-0d386d8eb9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:30.535509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70e09-5d8c-47f6-8014-0d386d8eb9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.535978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70e09-5d8c-47f6-8014-0d386d8eb9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.536401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70e09-5d8c-47f6-8014-0d386d8eb9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.542861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee70e09-5d8c-47f6-8014-0d386d8eb9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:30.547045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee70e09-5d8c-47f6-8014-0d386d8eb9b3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:30.571660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 855/1685] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:30.575303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:30.596080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa600af-5e66-4b9d-972a-3a5dc99e6173 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:30.608357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741b4c0-dd7b-4ca8-842f-cb014c2b0d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:30.609559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b4c0-dd7b-4ca8-842f-cb014c2b0d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.610435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b4c0-dd7b-4ca8-842f-cb014c2b0d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.610435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b4c0-dd7b-4ca8-842f-cb014c2b0d78 admin admin] PATH_INFO: `/v3/projects/18e306fc7e234658a5414fe44ce0db37/users/26fb0dc2ab094c81a122d9944ca32be8/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.636060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741b4c0-dd7b-4ca8-842f-cb014c2b0d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e306fc7e234658a5414fe44ce0db37, user_id=26fb0dc2ab094c81a122d9944ca32be8, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:30.638983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741b4c0-dd7b-4ca8-842f-cb014c2b0d78 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:30.645364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07780-fa83-4d64-853e-c288624a66f1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.645863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07780-fa83-4d64-853e-c288624a66f1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.646192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a07780-fa83-4d64-853e-c288624a66f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.669049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 831/1686] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:30 2022] PUT /identity/v3/projects/18e306fc7e234658a5414fe44ce0db37/users/26fb0dc2ab094c81a122d9944ca32be8/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:30.679814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bc724-603b-453c-b477-332dde5d334a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:30.680265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bc724-603b-453c-b477-332dde5d334a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:30.680644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bc724-603b-453c-b477-332dde5d334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:30.694861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:30.723462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-68a07780-fa83-4d64-853e-c288624a66f1 None None] MFA Rules not processed for user `c2632b005b784efc8fcbe90cb7376529`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:30.726260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-68a07780-fa83-4d64-853e-c288624a66f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:30.746865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b03bc724-603b-453c-b477-332dde5d334a None None] MFA Rules not processed for user `26fb0dc2ab094c81a122d9944ca32be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:30.747986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b03bc724-603b-453c-b477-332dde5d334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:30.896725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 832/1687] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:30.897807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bc724-603b-453c-b477-332dde5d334a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:30.899187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b03bc724-603b-453c-b477-332dde5d334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:30.921629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 856/1688] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:30.922764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a07780-fa83-4d64-853e-c288624a66f1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:31.009300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bc724-603b-453c-b477-332dde5d334a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:31.019694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:31.020531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.020863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.021610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] PATH_INFO: `/v3/projects/55e8d6fdef6444769c7c768a56d89526` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.022600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e8d6fdef6444769c7c768a56d89526)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:31.024932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:31.033899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a07780-fa83-4d64-853e-c288624a66f1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:31.041053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:31.042186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.044054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.044489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.046509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:31.049655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:31.057961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:31.105310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e8d6fdef6444769c7c768a56d89526', 'request_id': 'req-5c2436bf-d566-4bcc-9b52-4fd85e89a552'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:31.115464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e8d6fdef6444769c7c768a56d89526', 'request_id': 'req-5c2436bf-d566-4bcc-9b52-4fd85e89a552'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:31.124890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 857/1689] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:30 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:31.128405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:31.129335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e8d6fdef6444769c7c768a56d89526', 'request_id': 'req-5c2436bf-d566-4bcc-9b52-4fd85e89a552'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:31.140716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:31.157377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] The token cache is being invalidate because project 55e8d6fdef6444769c7c768a56d89526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:31.158916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:31.160178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:31.168061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 833/1690] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:30 2022] DELETE /identity/v3/projects/55e8d6fdef6444769c7c768a56d89526 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:31.170264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:31.176308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:31.243450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:31.312336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee48a6e-a1ec-4fc6-b77f-bfd7a4e5c780 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:31.320135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:31.321044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.321550 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.321952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.324059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:31.339678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2436bf-d566-4bcc-9b52-4fd85e89a552 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:31.482667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6cb9e-2b3e-4647-a21f-213f9f37285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:31.488020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6cb9e-2b3e-4647-a21f-213f9f37285e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.488393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6cb9e-2b3e-4647-a21f-213f9f37285e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.488736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6cb9e-2b3e-4647-a21f-213f9f37285e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.490283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6cb9e-2b3e-4647-a21f-213f9f37285e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:31.492985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6cb9e-2b3e-4647-a21f-213f9f37285e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:31.549338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:31.553700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 834/1691] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:31 2022] POST /identity/v3/users => generated 292 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:31.553700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764129-09bf-47d5-998a-47c8f2b3580e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.553700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764129-09bf-47d5-998a-47c8f2b3580e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.553700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764129-09bf-47d5-998a-47c8f2b3580e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.554124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 835/1692] 10.222.0.16 () {54 vars in 912 bytes} [Mon Sep 5 10:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:31.555145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b98f2-346d-4eac-93bb-4be7617bc226 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.555419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b98f2-346d-4eac-93bb-4be7617bc226 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.564574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b98f2-346d-4eac-93bb-4be7617bc226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.571160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:31.587674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 858/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:31.589171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:31.607357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64052821-37c9-4062-bd38-6eeba8f7539c service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:31.613269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabb2d4-1dff-4233-9720-e3c47e30b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:31.614075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabb2d4-1dff-4233-9720-e3c47e30b6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.614432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabb2d4-1dff-4233-9720-e3c47e30b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.614838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabb2d4-1dff-4233-9720-e3c47e30b6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.615524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabb2d4-1dff-4233-9720-e3c47e30b6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:31.618136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabb2d4-1dff-4233-9720-e3c47e30b6cc admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:31.625694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9a4b98f2-346d-4eac-93bb-4be7617bc226 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:31.626963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9a4b98f2-346d-4eac-93bb-4be7617bc226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:31.636574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 859/1694] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:31.636574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1d3b-8ed2-44d5-bc58-59a0c057dc31 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.636574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1d3b-8ed2-44d5-bc58-59a0c057dc31 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.636574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1d3b-8ed2-44d5-bc58-59a0c057dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.661332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 836/1695] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:31.662185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b98f2-346d-4eac-93bb-4be7617bc226 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:31.689794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b98f2-346d-4eac-93bb-4be7617bc226 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:31.700757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5a595-ff21-4182-96e0-6faa26cc0f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:31.704651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a595-ff21-4182-96e0-6faa26cc0f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.704937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a595-ff21-4182-96e0-6faa26cc0f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.705221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a595-ff21-4182-96e0-6faa26cc0f2b admin admin] PATH_INFO: `/v3/projects/176a7f1637cd4f5e8e12ca45f35a25c0/users/d9245a3e27ab4b0e91ec1c0783415bd1/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.775828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5a595-ff21-4182-96e0-6faa26cc0f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=176a7f1637cd4f5e8e12ca45f35a25c0, user_id=d9245a3e27ab4b0e91ec1c0783415bd1, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:31.785497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-31ff1d3b-8ed2-44d5-bc58-59a0c057dc31 None None] MFA Rules not processed for user `e5f6af1603974cdba70d0d7d78e6777d`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:31.786728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-31ff1d3b-8ed2-44d5-bc58-59a0c057dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:31.786841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5a595-ff21-4182-96e0-6faa26cc0f2b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:31.825416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 837/1696] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:31 2022] PUT /identity/v3/projects/176a7f1637cd4f5e8e12ca45f35a25c0/users/d9245a3e27ab4b0e91ec1c0783415bd1/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:31.826472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:31.826770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:31.827057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:31.902971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:31.904596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:31.954274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 860/1697] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:38:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:31.955263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff1d3b-8ed2-44d5-bc58-59a0c057dc31 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:31.982455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff1d3b-8ed2-44d5-bc58-59a0c057dc31 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:31.991992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:32.073082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 838/1698] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:32.073976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:32.078159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:32.113560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ebdce-926f-49ed-9549-5477780d2a15 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:32.127022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:32.127701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.127961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.128143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:32.128436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.128850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.128952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:32.129568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.129881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] PATH_INFO: `/v3/users/7fc9504b7e2f4a8e8c0d172896767031` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.130798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:32.132648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc9504b7e2f4a8e8c0d172896767031)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:32.139369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:32.153977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 861/1699] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:32.158426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:32.179243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c8de-9129-47f1-89bd-0566eab70884 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:32.192295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:32.192925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.193212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.193491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.194164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:32.194634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:32.196124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:32.227072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:32.229120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 862/1700] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:32.234668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:32.258469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ba6f5-956b-44b8-9658-e00ce590b520 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:32.271367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc9504b7e2f4a8e8c0d172896767031'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:32.272983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc9504b7e2f4a8e8c0d172896767031'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:32.274005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc9504b7e2f4a8e8c0d172896767031'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:32.275573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:32.276468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.276755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.277036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] PATH_INFO: `/v3/projects/176a7f1637cd4f5e8e12ca45f35a25c0/users/d9245a3e27ab4b0e91ec1c0783415bd1/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.280891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=176a7f1637cd4f5e8e12ca45f35a25c0, user_id=d9245a3e27ab4b0e91ec1c0783415bd1, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:32.286206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:32.291688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc9504b7e2f4a8e8c0d172896767031'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:32.315132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc9504b7e2f4a8e8c0d172896767031'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:32.320082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 863/1701] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:32 2022] PUT /identity/v3/projects/176a7f1637cd4f5e8e12ca45f35a25c0/users/d9245a3e27ab4b0e91ec1c0783415bd1/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:32.322863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:32.334304 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:32.351413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 839/1702] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:32 2022] DELETE /identity/v3/users/7fc9504b7e2f4a8e8c0d172896767031 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:32.352913 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:32.355620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:32.501377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418b75-223b-49d7-83a9-2248bcb9c87a admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:32.542201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a038a0-ee68-45fe-8b05-525ccebeb0ee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:32.559695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1619e-8b0c-4ac7-94e2-cecd729456a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:32.560609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1619e-8b0c-4ac7-94e2-cecd729456a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.562353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1619e-8b0c-4ac7-94e2-cecd729456a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.564606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1619e-8b0c-4ac7-94e2-cecd729456a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.565418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1619e-8b0c-4ac7-94e2-cecd729456a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:32.569367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1619e-8b0c-4ac7-94e2-cecd729456a2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:32.648629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 840/1703] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:32 2022] POST /identity/v3/projects => generated 363 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:32.650542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e63b7-73ca-4780-a823-5b412c9694e0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.652874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e63b7-73ca-4780-a823-5b412c9694e0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.653264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e63b7-73ca-4780-a823-5b412c9694e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.654048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729cef4-e819-4b8e-9142-4e9614601434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:32.656430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729cef4-e819-4b8e-9142-4e9614601434 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.657350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729cef4-e819-4b8e-9142-4e9614601434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.659731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729cef4-e819-4b8e-9142-4e9614601434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.662476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c729cef4-e819-4b8e-9142-4e9614601434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:32.704434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729cef4-e819-4b8e-9142-4e9614601434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:32.706108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729cef4-e819-4b8e-9142-4e9614601434 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:32.732754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 864/1704] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:32.738933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:32.739357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:32.739828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:32.746480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a12e63b7-73ca-4780-a823-5b412c9694e0 None None] MFA Rules not processed for user `d9245a3e27ab4b0e91ec1c0783415bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:32.748308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a12e63b7-73ca-4780-a823-5b412c9694e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:32.826015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:32.829871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:32.930930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:32.972666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 841/1705] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:32.974239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e63b7-73ca-4780-a823-5b412c9694e0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:33.010932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 865/1706] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:33.010932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:33.010932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.013073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:33.025807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46aa5d-04f7-402c-87c0-f2c7f5ce70c6 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:33.033967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:33.035169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:33.035649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:33.036163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] PATH_INFO: `/v3/users/df657ef737f643afa1c301d822fbcc4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:33.037792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=df657ef737f643afa1c301d822fbcc4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:33.040676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:33.201165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df657ef737f643afa1c301d822fbcc4c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:33.203334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df657ef737f643afa1c301d822fbcc4c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:33.236678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e63b7-73ca-4780-a823-5b412c9694e0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:33.247288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df657ef737f643afa1c301d822fbcc4c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:33.253220 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa746444-24f8-42fc-b295-8d4b6096993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:33.253944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746444-24f8-42fc-b295-8d4b6096993e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:33.259776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746444-24f8-42fc-b295-8d4b6096993e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:33.262504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746444-24f8-42fc-b295-8d4b6096993e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:33.263836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa746444-24f8-42fc-b295-8d4b6096993e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:33.269217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa746444-24f8-42fc-b295-8d4b6096993e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:33.273878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df657ef737f643afa1c301d822fbcc4c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:33.275827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df657ef737f643afa1c301d822fbcc4c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:33.319947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 866/1707] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:33 2022] DELETE /identity/v3/users/df657ef737f643afa1c301d822fbcc4c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:33.320881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:33.329351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.352904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 842/1708] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:32 2022] POST /identity/v3/users => generated 282 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:33.359334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:33.361167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:33.361334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:33.445315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] MFA Rules not processed for user `a0cb2ecdde264e8f863d6f8f024371af`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:33.448501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.477661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355531bc-ff28-42f1-8435-fdbd7e8b4eff admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:33.484817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8cebb-ee62-4f9b-99d9-dc2aeafcfe47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:33.486925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8cebb-ee62-4f9b-99d9-dc2aeafcfe47 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:33.487220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8cebb-ee62-4f9b-99d9-dc2aeafcfe47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:33.487532 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8cebb-ee62-4f9b-99d9-dc2aeafcfe47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:33.493639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-30f8cebb-ee62-4f9b-99d9-dc2aeafcfe47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.612152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 843/1709] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:33.613155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:33.618620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8cebb-ee62-4f9b-99d9-dc2aeafcfe47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:33.621784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.626525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8cebb-ee62-4f9b-99d9-dc2aeafcfe47 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:33.642602 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:33.663879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 867/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:33.665599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:33.666101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:33.666609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:33.729653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:33.731049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.805896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d169c-5ba8-4347-97d2-06a45b54a0e1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:33.814130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:33.814775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:33.815210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:33.815492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:33.823740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.950646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 868/1711] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:33.951721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:33.954803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:33.977996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:33.982092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac606a9a-4dcc-4ed3-97cf-a12844d61b59 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:33.988987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:33.989822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:33.990250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:33.990726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:33.991547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:33.993942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:34.016919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 869/1712] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:34.026258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:34.030541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:34.037400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:34.046717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:34.068817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 844/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:34.070147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:34.071556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:34.232978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a75d7-dd8c-4e09-b149-7a8902364b6f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:34.238273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c62c-2132-42ff-8ef2-75c081399e19 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:34.242562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:34.243391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:34.243884 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:34.244296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:34.244532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:34.245330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:34.245694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:34.245948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:34.248096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:34.257604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:34.260458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:34.286464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:34.293028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 870/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:34.293633 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:34.297322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:34.320512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f8172-8c13-4dbd-a8e0-65cf4a91292e service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:34.340252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:34.345287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:34.345580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:34.345889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:34.355989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 845/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:34.359630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:34.370261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:34.371798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:34.393448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 871/1716] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:34.422503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cd7b9-fa87-4d8e-b28c-345ae6753807 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:34.437622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:34.438372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:34.438658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:34.438994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:34.439715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:34.442762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:34.470606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 846/1717] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:34.473468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:34.493731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6f0d9-fde9-420d-a592-ea3865cf6ac3 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:34.521368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a912a3-84b7-4d32-a93a-4667208286a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:34.522134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a912a3-84b7-4d32-a93a-4667208286a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:34.522421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a912a3-84b7-4d32-a93a-4667208286a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:34.522730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a912a3-84b7-4d32-a93a-4667208286a1 admin admin] PATH_INFO: `/v3/projects/9de6ab0102424f268039980785f8f554/users/5a8b3cb793674b0986ef7ffb24f224ad/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:34.583817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a912a3-84b7-4d32-a93a-4667208286a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de6ab0102424f268039980785f8f554, user_id=5a8b3cb793674b0986ef7ffb24f224ad, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:34.586593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a912a3-84b7-4d32-a93a-4667208286a1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:34.631735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 872/1718] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:34 2022] PUT /identity/v3/projects/9de6ab0102424f268039980785f8f554/users/5a8b3cb793674b0986ef7ffb24f224ad/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:34.632377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:34.632377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:34.655951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e52c-c1ab-414a-8820-3672ef143140 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:34.655951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e52c-c1ab-414a-8820-3672ef143140 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:34.659099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e52c-c1ab-414a-8820-3672ef143140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:34.711372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4d30-32f5-49ed-b6aa-6d04f64ace90 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:34.773026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f6f2e52c-c1ab-414a-8820-3672ef143140 None None] MFA Rules not processed for user `5a8b3cb793674b0986ef7ffb24f224ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:34.774168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f6f2e52c-c1ab-414a-8820-3672ef143140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:34.892410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:34.943632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:34.944405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:34.944575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:34.944854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] PATH_INFO: `/v3/users/26fb0dc2ab094c81a122d9944ca32be8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:34.946663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fb0dc2ab094c81a122d9944ca32be8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:34.948679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:35.080946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 873/1719] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:35.084614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2e52c-c1ab-414a-8820-3672ef143140 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:35.118188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fb0dc2ab094c81a122d9944ca32be8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.118439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2e52c-c1ab-414a-8820-3672ef143140 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:35.119638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fb0dc2ab094c81a122d9944ca32be8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.122722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fb0dc2ab094c81a122d9944ca32be8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.163774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fb0dc2ab094c81a122d9944ca32be8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.167743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:35.168393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:35.168676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:35.168954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:35.169608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:35.179497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:35.184009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:35.210594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-01b445db-51f3-441c-8cf5-a0e96358c0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fb0dc2ab094c81a122d9944ca32be8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.242518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 847/1720] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:34 2022] DELETE /identity/v3/users/26fb0dc2ab094c81a122d9944ca32be8 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:35.249697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:35.249984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:35.253095 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:35.310615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 874/1721] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:35 2022] POST /identity/v3/projects => generated 365 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:35.311807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:35.316508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:35.321349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:35.323406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:35.579720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a534de0-5ff9-4fce-a1df-8af9c8d4a00a admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:35.581391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 848/1722] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:35.582106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:35.588933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:35.591307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:35.591895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:35.592380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:35.594614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:35.594747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:35.597144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:35.658716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 875/1723] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:35 2022] POST /identity/v3/users => generated 289 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:35.661735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c770cc-7a87-4901-abf0-bcc11f0fe872 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:35.663196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:35.669683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:35.684961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:35.687670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:35.687822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:35.688249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] PATH_INFO: `/v3/projects/40facf3616c64b52a05029afce9e58a9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:35.694343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=40facf3616c64b52a05029afce9e58a9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:35.694599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:35.774371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca26a-6d45-44bf-b080-60bcfc31d01c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:35.785339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:35.786102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:35.786581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:35.786935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:35.810892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:35.814228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:35.817750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40facf3616c64b52a05029afce9e58a9', 'request_id': 'req-1a868808-43ca-420d-a47f-62f6fcec40ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.826748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40facf3616c64b52a05029afce9e58a9', 'request_id': 'req-1a868808-43ca-420d-a47f-62f6fcec40ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.842805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 876/1724] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:35.845468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:35.852354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40facf3616c64b52a05029afce9e58a9', 'request_id': 'req-1a868808-43ca-420d-a47f-62f6fcec40ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.859715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b0260-0c29-4e17-b93b-b34605da494b service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:35.877558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] The token cache is being invalidate because project 40facf3616c64b52a05029afce9e58a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:35.877930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.878995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:35.884499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 849/1725] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:35 2022] DELETE /identity/v3/projects/40facf3616c64b52a05029afce9e58a9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:35.884499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:35.885552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:35.992310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:36.082713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a038b6-d071-4ae5-bf2f-ffbb6406629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:36.083854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a038b6-d071-4ae5-bf2f-ffbb6406629b admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.093307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a038b6-d071-4ae5-bf2f-ffbb6406629b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.093744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a038b6-d071-4ae5-bf2f-ffbb6406629b admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.096562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a038b6-d071-4ae5-bf2f-ffbb6406629b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:36.102328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a038b6-d071-4ae5-bf2f-ffbb6406629b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:36.154338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 877/1726] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:36.157851 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a868808-43ca-420d-a47f-62f6fcec40ff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:36.160876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e27ee-96dd-45e3-bd7c-80d2e3ef0f81 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.161193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e27ee-96dd-45e3-bd7c-80d2e3ef0f81 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.161495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e27ee-96dd-45e3-bd7c-80d2e3ef0f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.177673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:36.181152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.185024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.185386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] PATH_INFO: `/v3/projects/095379a82f22428b8613e6aad211bf74` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.193411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095379a82f22428b8613e6aad211bf74)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:36.200390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:36.224695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:36.244256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b09e27ee-96dd-45e3-bd7c-80d2e3ef0f81 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:36.247760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b09e27ee-96dd-45e3-bd7c-80d2e3ef0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:36.292379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 878/1727] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:36.301175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902090f-f744-404d-8bbb-5db74643fe56 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.301468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902090f-f744-404d-8bbb-5db74643fe56 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.301756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902090f-f744-404d-8bbb-5db74643fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.354538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-4902090f-f744-404d-8bbb-5db74643fe56 None None] MFA Rules not processed for user `c2632b005b784efc8fcbe90cb7376529`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:36.362616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4902090f-f744-404d-8bbb-5db74643fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:36.366900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095379a82f22428b8613e6aad211bf74', 'request_id': 'req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:36.407089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095379a82f22428b8613e6aad211bf74', 'request_id': 'req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:36.428789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095379a82f22428b8613e6aad211bf74', 'request_id': 'req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:36.463507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] The token cache is being invalidate because project 095379a82f22428b8613e6aad211bf74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:36.464799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:36.467426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:36.467746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 850/1728] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:35 2022] DELETE /identity/v3/projects/095379a82f22428b8613e6aad211bf74 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:36.471706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:36.476206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 879/1729] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:36.476707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:36.480696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248939-881f-45e9-a7ad-f1e675fb1263 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.482296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248939-881f-45e9-a7ad-f1e675fb1263 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.482735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248939-881f-45e9-a7ad-f1e675fb1263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.584910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5e248939-881f-45e9-a7ad-f1e675fb1263 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:36.598841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5e248939-881f-45e9-a7ad-f1e675fb1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:36.681206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4de4cf-4fb2-47f4-ab8e-2c8700e69bf0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:36.697924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:36.698888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.699734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.700295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] PATH_INFO: `/v3/projects/e68ead21491d457abcaf5c403e58186c/users/25a4917debf844039bfeaf9fdb0bff72/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.728097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68ead21491d457abcaf5c403e58186c, user_id=25a4917debf844039bfeaf9fdb0bff72, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:36.735275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:36.761289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 851/1730] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:36 2022] PUT /identity/v3/projects/e68ead21491d457abcaf5c403e58186c/users/25a4917debf844039bfeaf9fdb0bff72/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:36.762552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:36.764605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:36.777576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 880/1731] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:36.778860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248939-881f-45e9-a7ad-f1e675fb1263 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:36.793948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248939-881f-45e9-a7ad-f1e675fb1263 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:36.887885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:36.888617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.888903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.889184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.890179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:36.893429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:36.907527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 881/1732] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:36.908450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:36.922490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb5caa-0308-4cd8-8e78-d4c49f430718 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:36.934675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:36.935314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:36.935638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:36.935902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:36.937434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:36.937697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:36.939343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:36.941878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:36.967169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 882/1733] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:36.969863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:36.999954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d437b-39f9-4d6c-8b6f-e7e505b9d04e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.006526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:37.008261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.009836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.010212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] PATH_INFO: `/v3/projects/e68ead21491d457abcaf5c403e58186c/users/25a4917debf844039bfeaf9fdb0bff72/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.016190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5776c3e-de6e-425a-8761-ded93c067a3d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.034576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68ead21491d457abcaf5c403e58186c, user_id=25a4917debf844039bfeaf9fdb0bff72, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:37.050453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:37.055433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:37.056173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.056466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.056753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] PATH_INFO: `/v3/users/563c3bf7a09749b585c350accd38f590` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.059989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563c3bf7a09749b585c350accd38f590)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:37.063043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:37.089434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 883/1734] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:36 2022] PUT /identity/v3/projects/e68ead21491d457abcaf5c403e58186c/users/25a4917debf844039bfeaf9fdb0bff72/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:37.089434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:37.119131 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:37.199402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1821a-0ec3-476b-ada6-2f912138aec2 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.206938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bc635-5417-4cc5-a10a-92d51729ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:37.207851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bc635-5417-4cc5-a10a-92d51729ede5 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.208139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bc635-5417-4cc5-a10a-92d51729ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.208596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bc635-5417-4cc5-a10a-92d51729ede5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.209251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bc635-5417-4cc5-a10a-92d51729ede5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:37.212638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bc635-5417-4cc5-a10a-92d51729ede5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:37.250256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563c3bf7a09749b585c350accd38f590'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:37.254058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563c3bf7a09749b585c350accd38f590'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:37.259321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563c3bf7a09749b585c350accd38f590'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:37.291137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563c3bf7a09749b585c350accd38f590'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:37.311376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 884/1735] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:37 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:37.321727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.322018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.328247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.332639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563c3bf7a09749b585c350accd38f590'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:37.362792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 852/1736] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:36 2022] DELETE /identity/v3/users/563c3bf7a09749b585c350accd38f590 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:37.364029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:37.365473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:37.438074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] MFA Rules not processed for user `25a4917debf844039bfeaf9fdb0bff72`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:37.443014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:37.547579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f427d9a-f516-4c06-a1ab-fd28bab5c6d8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.562687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:37.563839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.564173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.564556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.568098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:37.578320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:37.618794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 853/1737] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:37 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:37.624599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:37.641642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc2f7-4443-467b-8089-cebd5d76ef98 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.648110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:37.650428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.651537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.653907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.657202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:37.663395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:37.690703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 854/1738] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:37.694789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:37.730268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 885/1739] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:37.735206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dafa06-2f67-4ad4-ad1c-375403ca5c1c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.740659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:37.741403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.741788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.742066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.742887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:37.744546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:37.750640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:37.752670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:37.785497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 855/1740] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:37.787044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:37.803541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddd0b5-1377-46ed-b161-2cea93e61f38 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.818434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e319e62-c668-4991-9e4e-2e46dba84dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:37.819679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319e62-c668-4991-9e4e-2e46dba84dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.819982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319e62-c668-4991-9e4e-2e46dba84dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.820421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319e62-c668-4991-9e4e-2e46dba84dc7 admin admin] PATH_INFO: `/v3/projects/12995ea64493480ab2dc737d9366dc34/users/008a4737863d4d91ba565b0fda65cfa0/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.854218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319e62-c668-4991-9e4e-2e46dba84dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12995ea64493480ab2dc737d9366dc34, user_id=008a4737863d4d91ba565b0fda65cfa0, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:37.867961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319e62-c668-4991-9e4e-2e46dba84dc7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:37.896442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 856/1741] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:37 2022] PUT /identity/v3/projects/12995ea64493480ab2dc737d9366dc34/users/008a4737863d4d91ba565b0fda65cfa0/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:37.908673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864929f-0b0c-474b-aa99-23a7704912d6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:37.908964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864929f-0b0c-474b-aa99-23a7704912d6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:37.909272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864929f-0b0c-474b-aa99-23a7704912d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:37.917580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9596ab8-bda8-4273-9aab-794a1ab908dc None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:37.922204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:37.989948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1864929f-0b0c-474b-aa99-23a7704912d6 None None] MFA Rules not processed for user `008a4737863d4d91ba565b0fda65cfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:37.994504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1864929f-0b0c-474b-aa99-23a7704912d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:38.000210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:38.000932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:38.001244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:38.001527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:38.112553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:38.118676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:38.119044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:38.140811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 886/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:38:38.222742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 857/1743] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:38.228221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:38.343788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000440-6c56-4629-ad02-4b0f1cff316e service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:38.356172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:38.357086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:38.357342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864929f-0b0c-474b-aa99-23a7704912d6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:38.357500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:38.359378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:38.360290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:38.363183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:38.377982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864929f-0b0c-474b-aa99-23a7704912d6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:38.395544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:38.396460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:38.396618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:38.396898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:38.398956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:38.430340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 887/1744] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:38 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:38.431939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:38.434024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:38.523085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:38.583512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:38.585747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7429f-7eb8-4752-bce3-528cf4ff9d39 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:38.586644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:38.599453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:38.600175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:38.600457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:38.600732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] PATH_INFO: `/v3/projects/18e306fc7e234658a5414fe44ce0db37` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:38.602832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e306fc7e234658a5414fe44ce0db37)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:38.607857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 858/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:38.608260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:38.611214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:38.648857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7737c1-f516-4901-b7ca-466ffa2cdd12 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:38.659540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:38.662418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:38.662711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:38.662990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:38.664235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:38.666218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:38.724184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 859/1746] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:38 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:38.728327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:38.732757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e306fc7e234658a5414fe44ce0db37', 'request_id': 'req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:38.745219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e306fc7e234658a5414fe44ce0db37', 'request_id': 'req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:38.749556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36a84-9b83-4c2a-a233-8b088d8e3087 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:38.765728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e306fc7e234658a5414fe44ce0db37', 'request_id': 'req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:38.807051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] The token cache is being invalidate because project 18e306fc7e234658a5414fe44ce0db37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:38.807343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:38.808220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:38.813756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 888/1747] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:38 2022] DELETE /identity/v3/projects/18e306fc7e234658a5414fe44ce0db37 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:38.817534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:38.820493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:38.949157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb8f7f-1738-4ef5-9a0b-301b3d25180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:38.949886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb8f7f-1738-4ef5-9a0b-301b3d25180f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:38.950245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb8f7f-1738-4ef5-9a0b-301b3d25180f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:38.950600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb8f7f-1738-4ef5-9a0b-301b3d25180f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:38.951434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb8f7f-1738-4ef5-9a0b-301b3d25180f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:38.954611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb8f7f-1738-4ef5-9a0b-301b3d25180f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:38.979912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 860/1748] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:38.984487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:38.984917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:38.985277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:39.077885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ffb05-5dd7-486c-a56a-3fd5707606f3 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:39.113419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:39.118381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:39.118680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:39.118961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] PATH_INFO: `/v3/users/d9245a3e27ab4b0e91ec1c0783415bd1` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:39.128354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9245a3e27ab4b0e91ec1c0783415bd1)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:39.138214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:39.173306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:39.174239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:39.243309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:39.321083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9245a3e27ab4b0e91ec1c0783415bd1'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:39.322709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9245a3e27ab4b0e91ec1c0783415bd1'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:39.357851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9245a3e27ab4b0e91ec1c0783415bd1'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:39.372182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9245a3e27ab4b0e91ec1c0783415bd1'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:39.372840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9245a3e27ab4b0e91ec1c0783415bd1'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:39.377261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:39.397925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 861/1749] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:39.398874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:39.402517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:39.422246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 889/1750] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:38 2022] DELETE /identity/v3/users/d9245a3e27ab4b0e91ec1c0783415bd1 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:39.436563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f79f85-762a-4880-96cb-f075c0ba1016 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:39.672209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:39.675732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:39.683246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:39.684127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:39.684418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:39.684721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] PATH_INFO: `/v3/projects/7701e930fbef4e1fbec92a555730a6aa/users/b320a232f3bd4648897894e5fd474f39/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:39.724258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7701e930fbef4e1fbec92a555730a6aa, user_id=b320a232f3bd4648897894e5fd474f39, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:39.729461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:39.763253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 862/1751] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:39 2022] PUT /identity/v3/projects/7701e930fbef4e1fbec92a555730a6aa/users/b320a232f3bd4648897894e5fd474f39/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:39.768755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:39.934571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5d58e-5552-4655-b30f-d4d8604e5c8f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:39.946829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:39.947739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:39.948207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:39.948705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:39.950460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:39.954944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:39.956530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617375e-8c73-4510-bb58-0dbba8ca21b7 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:39.979242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 863/1752] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:39.984511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:40.006000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6247f88-475b-4407-964d-7533a4bdd50e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:40.019126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec279d-160b-418e-b402-c4a32fa2e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:40.022995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec279d-160b-418e-b402-c4a32fa2e191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:40.023289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec279d-160b-418e-b402-c4a32fa2e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:40.024272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec279d-160b-418e-b402-c4a32fa2e191 admin admin] PATH_INFO: `/v3/projects/7701e930fbef4e1fbec92a555730a6aa/users/b320a232f3bd4648897894e5fd474f39/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:40.027704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec279d-160b-418e-b402-c4a32fa2e191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7701e930fbef4e1fbec92a555730a6aa, user_id=b320a232f3bd4648897894e5fd474f39, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:40.034446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec279d-160b-418e-b402-c4a32fa2e191 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:40.075517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 864/1753] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:39 2022] PUT /identity/v3/projects/7701e930fbef4e1fbec92a555730a6aa/users/b320a232f3bd4648897894e5fd474f39/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:40.080231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:40.080520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:40.080899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:40.105568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3a82b-7673-42f9-a3f9-e5257f5e1171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:40.106254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a82b-7673-42f9-a3f9-e5257f5e1171 service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:40.106543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a82b-7673-42f9-a3f9-e5257f5e1171 service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:40.106823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a82b-7673-42f9-a3f9-e5257f5e1171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:40.178925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] MFA Rules not processed for user `b320a232f3bd4648897894e5fd474f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:40.180217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:40.212955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3a82b-7673-42f9-a3f9-e5257f5e1171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:40.215447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3a82b-7673-42f9-a3f9-e5257f5e1171 service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:40.226665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:40.246701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 890/1754] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:38:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 10:38:40.248123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:40.248420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:40.250649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:40.310494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] MFA Rules not processed for user `a0cb2ecdde264e8f863d6f8f024371af`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:40.317469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:40.361775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:40.479313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 865/1755] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:40.480346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 891/1756] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:40.480604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:40.482108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:40.585408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:40.586928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:40.751411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc84650-c4b6-4f19-a243-32f7c3c2c611 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:40.772714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:40.773147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:40.776718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:40.777738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] PATH_INFO: `/v3/projects/a1057f4d6f9c48cda4b15b62960eecfc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:40.780578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1057f4d6f9c48cda4b15b62960eecfc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:40.783033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:40.812915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5709ee-820c-4e23-aeb0-4a92574bb397 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:40.830928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:40.831565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:40.843325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:40.844154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:40.865911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:40.868564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:40.896515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 892/1757] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:38:40.992544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:40.994441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:41.008440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1057f4d6f9c48cda4b15b62960eecfc', 'request_id': 'req-af07efea-f09a-4f82-a644-9d7dbdcd167b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.046804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a486-ddc9-4a7c-930d-fd2a49c5878d service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:41.050823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1057f4d6f9c48cda4b15b62960eecfc', 'request_id': 'req-af07efea-f09a-4f82-a644-9d7dbdcd167b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.080227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1057f4d6f9c48cda4b15b62960eecfc', 'request_id': 'req-af07efea-f09a-4f82-a644-9d7dbdcd167b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.117197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] The token cache is being invalidate because project a1057f4d6f9c48cda4b15b62960eecfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:41.118201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.122135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-af07efea-f09a-4f82-a644-9d7dbdcd167b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.136385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 866/1758] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:40 2022] DELETE /identity/v3/projects/a1057f4d6f9c48cda4b15b62960eecfc => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:41.140765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:41.141313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:41.143494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:41.208777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:41.210869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:41.337670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:41.338341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:41.338658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:41.338899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] PATH_INFO: `/v3/projects/176a7f1637cd4f5e8e12ca45f35a25c0` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:41.343914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:41.345177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=176a7f1637cd4f5e8e12ca45f35a25c0)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:41.347157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:41.458728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 867/1759] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:41.460233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:41.463125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:41.516782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176a7f1637cd4f5e8e12ca45f35a25c0', 'request_id': 'req-4b9d4fd6-9715-4786-8eca-b5931d441d1e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.531693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176a7f1637cd4f5e8e12ca45f35a25c0', 'request_id': 'req-4b9d4fd6-9715-4786-8eca-b5931d441d1e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.550317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176a7f1637cd4f5e8e12ca45f35a25c0', 'request_id': 'req-4b9d4fd6-9715-4786-8eca-b5931d441d1e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.560924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:41.590599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] The token cache is being invalidate because project 176a7f1637cd4f5e8e12ca45f35a25c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:41.591165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.592134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b9d4fd6-9715-4786-8eca-b5931d441d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:41.595741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 893/1760] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:40 2022] DELETE /identity/v3/projects/176a7f1637cd4f5e8e12ca45f35a25c0 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:41.597615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3828b6-cb2c-4baa-93c0-b188b388fbf3 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:41.598133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3828b6-cb2c-4baa-93c0-b188b388fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:41.598714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3828b6-cb2c-4baa-93c0-b188b388fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:41.660725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-4b3828b6-cb2c-4baa-93c0-b188b388fbf3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:41.662416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4b3828b6-cb2c-4baa-93c0-b188b388fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:41.761831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921400c-1850-4f3e-8d7c-fc3f831b8ddc None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:41.897159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 894/1761] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:41.899505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079dde-48e3-4c21-ad52-c89a1cd63366 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:41.899827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079dde-48e3-4c21-ad52-c89a1cd63366 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:41.900170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079dde-48e3-4c21-ad52-c89a1cd63366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:41.944498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a5079dde-48e3-4c21-ad52-c89a1cd63366 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:41.946787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a5079dde-48e3-4c21-ad52-c89a1cd63366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:41.971466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 895/1762] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:41.972507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079dde-48e3-4c21-ad52-c89a1cd63366 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:41.982154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:41.983768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:41.984303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:41.984930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:41.987136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:41.997133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079dde-48e3-4c21-ad52-c89a1cd63366 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:42.015650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b750f-83f2-4818-a90c-a362dbefd6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:42.015650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b750f-83f2-4818-a90c-a362dbefd6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.015650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b750f-83f2-4818-a90c-a362dbefd6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.015650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b750f-83f2-4818-a90c-a362dbefd6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.017864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b750f-83f2-4818-a90c-a362dbefd6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:42.017864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b750f-83f2-4818-a90c-a362dbefd6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.020901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b750f-83f2-4818-a90c-a362dbefd6ed admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.054593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 896/1763] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:42.056605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8b2f-f9cf-4b4b-b5b2-9126ebf7ca7a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.057008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8b2f-f9cf-4b4b-b5b2-9126ebf7ca7a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.057633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8b2f-f9cf-4b4b-b5b2-9126ebf7ca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.108368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-420a8b2f-f9cf-4b4b-b5b2-9126ebf7ca7a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:42.113212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-420a8b2f-f9cf-4b4b-b5b2-9126ebf7ca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:42.141850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 897/1764] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:42.143108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a8b2f-f9cf-4b4b-b5b2-9126ebf7ca7a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:42.166622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a8b2f-f9cf-4b4b-b5b2-9126ebf7ca7a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:42.189290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:42.190794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.191478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.191908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.192862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.195074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.272611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.276973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.288776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 898/1765] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:42 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:42.293229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:42.301645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 868/1766] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 842 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:42.303279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:42.336991 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14d659-d585-425d-a756-9447ff12027b service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:42.519303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:42.546818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:42.547239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.549999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.550298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.551995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.557625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.618507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8f2ed-d81f-4f3c-9945-c12e20c6b202 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:42.642063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:42.650088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.650088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.650088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.650088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:42.650088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.652673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.655297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 869/1767] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:42 2022] POST /identity/v3/users => generated 285 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:42.658193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:42.698410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955666-6443-4de0-943a-3f1307e1e3f6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:42.699712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 899/1768] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:42.701638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:42.707219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:42.707940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.708153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.708435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.725069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.726765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.736720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e419-defd-4ca9-99b8-ae0f6633e2c1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:42.753814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706fdd-3dad-447d-b136-45eb2fca6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:42.755060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706fdd-3dad-447d-b136-45eb2fca6f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.756854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706fdd-3dad-447d-b136-45eb2fca6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.756854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706fdd-3dad-447d-b136-45eb2fca6f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.768489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706fdd-3dad-447d-b136-45eb2fca6f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.774554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 870/1769] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:42.775643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:42.777429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706fdd-3dad-447d-b136-45eb2fca6f73 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.809185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a52ecd-4338-43be-a83e-4d4675c92e6f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:42.825082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf02bf-454b-41d2-9960-223d924467d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:42.825702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf02bf-454b-41d2-9960-223d924467d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.825997 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf02bf-454b-41d2-9960-223d924467d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.827102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf02bf-454b-41d2-9960-223d924467d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.827991 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf02bf-454b-41d2-9960-223d924467d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:42.829865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf02bf-454b-41d2-9960-223d924467d9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:42.851004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 871/1770] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:42.852476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565924c4-8ab3-46a6-82a3-8dd185060d6b None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.852775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565924c4-8ab3-46a6-82a3-8dd185060d6b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.853055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565924c4-8ab3-46a6-82a3-8dd185060d6b None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.857477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 872/1771] 10.222.0.16 () {54 vars in 912 bytes} [Mon Sep 5 10:38:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:42.860159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565924c4-8ab3-46a6-82a3-8dd185060d6b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:42.885038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 900/1772] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:42 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:42.886342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a1c8-9be9-443e-9938-1bcc7ecf4c26 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:42.886624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a1c8-9be9-443e-9938-1bcc7ecf4c26 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:42.891310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a1c8-9be9-443e-9938-1bcc7ecf4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:42.902266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565924c4-8ab3-46a6-82a3-8dd185060d6b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:43.027686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-94e6a1c8-9be9-443e-9938-1bcc7ecf4c26 None None] MFA Rules not processed for user `e5f6af1603974cdba70d0d7d78e6777d`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:43.029100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-94e6a1c8-9be9-443e-9938-1bcc7ecf4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:43.100058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:43.128673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:43.133129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:43.133427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:43.137919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] PATH_INFO: `/v3/projects/7c12f82065ac424dab0b5ba85b2d1a1c/users/398d7a29e3ce494f8f719fc94795037f/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:43.193389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 901/1773] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:43.194220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6a1c8-9be9-443e-9938-1bcc7ecf4c26 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:43.196620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c12f82065ac424dab0b5ba85b2d1a1c, user_id=398d7a29e3ce494f8f719fc94795037f, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:43.214389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:43.216260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6a1c8-9be9-443e-9938-1bcc7ecf4c26 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:43.230507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ce413-3764-4873-b402-4d34348e3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:43.231265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce413-3764-4873-b402-4d34348e3ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:43.231701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce413-3764-4873-b402-4d34348e3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:43.232088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce413-3764-4873-b402-4d34348e3ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:43.232916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ce413-3764-4873-b402-4d34348e3ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:43.238798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ce413-3764-4873-b402-4d34348e3ca8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:43.259089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 873/1774] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:42 2022] PUT /identity/v3/projects/7c12f82065ac424dab0b5ba85b2d1a1c/users/398d7a29e3ce494f8f719fc94795037f/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:43.260161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:43.275014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:43.292838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 902/1775] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:43 2022] POST /identity/v3/users => generated 279 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:43.295100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c64e-07d4-4326-9491-44e5a5de59fe None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:43.295696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c64e-07d4-4326-9491-44e5a5de59fe None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:43.296117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3c64e-07d4-4326-9491-44e5a5de59fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:43.369170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-bbd3c64e-07d4-4326-9491-44e5a5de59fe None None] MFA Rules not processed for user `398d7a29e3ce494f8f719fc94795037f`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:43.371187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-bbd3c64e-07d4-4326-9491-44e5a5de59fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:43.604793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e769a-0e51-475d-840a-45dbe5877e7c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:43.612599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 903/1776] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:43.618221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c64e-07d4-4326-9491-44e5a5de59fe None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:43.622807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:43.623483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:43.624373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:43.624655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:43.648146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:43.651536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:43.673423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 874/1777] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:43.674139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:43.786832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:43.830802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174ec8-1fd5-46de-8cb3-f85451495425 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:43.856364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:43.857000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:43.857285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:43.857563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:43.858251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:43.860221 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:43.914442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3c64e-07d4-4326-9491-44e5a5de59fe None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:43.929802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:43.929802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:43.934001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:43.956771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:43.961103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:43.967544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:43.972784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 875/1778] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:43 2022] POST /identity/v3/projects => generated 367 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:43.975459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:44.006283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 904/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:44.008895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:44.015199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:44.057533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8cc25-8c69-4f26-9975-0c04f4087928 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:44.152446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d6fa-81fc-475c-b21d-2226d88c068c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:44.165568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:44.166462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:44.166843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:44.167357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:44.169766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:44.179144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:44.220011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:44.253219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 876/1780] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:43 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:38:44.256201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:44.321151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be064fb6-d2df-4877-a588-2fad977c1f9c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:44.351450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:44.354201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:44.354336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:44.355208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:44.357312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:44.362430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:44.363103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:44.363387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:44.364901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:44.369506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] PATH_INFO: `/v3/users/5a8b3cb793674b0986ef7ffb24f224ad` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:44.372660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8b3cb793674b0986ef7ffb24f224ad)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:44.374973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:44.474652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 877/1781] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:44.477003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:44.556408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c888bc-d790-4a3f-b00f-c8b49bd5e14e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:44.588372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b23ad3-1343-4bb9-b041-041d17a38cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:44.598426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b23ad3-1343-4bb9-b041-041d17a38cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:44.598722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b23ad3-1343-4bb9-b041-041d17a38cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:44.599015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b23ad3-1343-4bb9-b041-041d17a38cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:44.599743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b23ad3-1343-4bb9-b041-041d17a38cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:44.612668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b23ad3-1343-4bb9-b041-041d17a38cc5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:44.686108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 878/1782] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:44.692737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:44.693030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:44.697608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:44.699433 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8b3cb793674b0986ef7ffb24f224ad'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:44.703610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8b3cb793674b0986ef7ffb24f224ad'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:44.776774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8b3cb793674b0986ef7ffb24f224ad'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:44.797715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] MFA Rules not processed for user `e5f6af1603974cdba70d0d7d78e6777d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:44.799574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:44.805152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8b3cb793674b0986ef7ffb24f224ad'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:44.805844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8b3cb793674b0986ef7ffb24f224ad'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:44.851555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 905/1783] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:44 2022] DELETE /identity/v3/users/5a8b3cb793674b0986ef7ffb24f224ad => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:44.854661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:44.857223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:45.069225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 879/1784] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 5 10:38:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:45.074921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a8b7c-1366-437b-93a7-394313470c29 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:45.078715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:45.084535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:45.095775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaf0cb-d483-47ea-b0ed-c769d35903d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:45.096808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaf0cb-d483-47ea-b0ed-c769d35903d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:45.097213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaf0cb-d483-47ea-b0ed-c769d35903d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:45.097668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaf0cb-d483-47ea-b0ed-c769d35903d5 admin admin] PATH_INFO: `/v3/projects/e2d56479ba444d35ac991ecc5a7894fa/users/99eb6445288b429ab66d0d3a53304e3a/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:45.128192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaf0cb-d483-47ea-b0ed-c769d35903d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d56479ba444d35ac991ecc5a7894fa, user_id=99eb6445288b429ab66d0d3a53304e3a, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:45.132580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaf0cb-d483-47ea-b0ed-c769d35903d5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:45.145030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5e83-b234-498b-b6a6-4ddcd82a9a7b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:45.177685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 906/1785] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:44 2022] PUT /identity/v3/projects/e2d56479ba444d35ac991ecc5a7894fa/users/99eb6445288b429ab66d0d3a53304e3a/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:45.180920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcd75-af55-4819-94ee-7b3a4f421f2f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:45.181276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcd75-af55-4819-94ee-7b3a4f421f2f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:45.181482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcd75-af55-4819-94ee-7b3a4f421f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:45.241720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7e8dcd75-af55-4819-94ee-7b3a4f421f2f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:45.245288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7e8dcd75-af55-4819-94ee-7b3a4f421f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:45.308538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:45.351777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:45.353540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:45.354088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:45.354375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:45.357157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] PATH_INFO: `/v3/projects/63b38785fea842a1bc235f70f53cc28c/users/f188308b35af4a0ab1e341ee65a82e92/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:45.402603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b38785fea842a1bc235f70f53cc28c, user_id=f188308b35af4a0ab1e341ee65a82e92, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:45.420201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:45.492745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 907/1787] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:45.493108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 880/1787] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:45 2022] PUT /identity/v3/projects/63b38785fea842a1bc235f70f53cc28c/users/f188308b35af4a0ab1e341ee65a82e92/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:45.494058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:45.497216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6ee0f-67f4-44a9-a3fc-8e64d97ded92 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:45.497628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6ee0f-67f4-44a9-a3fc-8e64d97ded92 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:45.498512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6ee0f-67f4-44a9-a3fc-8e64d97ded92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:45.515934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:45.561380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-cda6ee0f-67f4-44a9-a3fc-8e64d97ded92 None None] MFA Rules not processed for user `99eb6445288b429ab66d0d3a53304e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:45.563548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cda6ee0f-67f4-44a9-a3fc-8e64d97ded92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:45.902487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 908/1788] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:45.912283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6ee0f-67f4-44a9-a3fc-8e64d97ded92 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:45.937682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dc1bc-e288-4067-8c15-e6c0bec1b2cf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:45.947119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:45.949895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:45.953134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:45.953820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:45.971146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:45.977948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:46.010685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 881/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:46.012759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:46.020129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:46.049635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a55b7-1da2-4ab0-990d-349ecb35812e service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:46.064663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:46.068103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:46.070151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:46.072311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:46.229481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6ee0f-67f4-44a9-a3fc-8e64d97ded92 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:46.263647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:46.264865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:46.265145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:46.265419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:46.266310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:46.278561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:46.331393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 909/1790] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:46.333707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:46.346791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516195-4b00-4271-9c21-92fbc91a0a99 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:46.353932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:46.354902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:46.355279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:46.355612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:46.357175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:46.381289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:46.387149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:46.425602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:46.472363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 882/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:46.487056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 910/1792] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:46 2022] POST /identity/v3/projects => generated 357 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:46.490277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:46.494954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:46.538752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7bb27-5311-4c8a-835d-539753105376 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:46.668474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:46.762631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a68708-3476-44f9-b1ec-e5d8477b7fde admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:46.777816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:46.778628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:46.778917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:46.784094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:46.785078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:46.792457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:46.802842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4065eff-ffaf-48d3-bd3d-5a05ef5d4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:46.803950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065eff-ffaf-48d3-bd3d-5a05ef5d4027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:46.804177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065eff-ffaf-48d3-bd3d-5a05ef5d4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:46.804461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065eff-ffaf-48d3-bd3d-5a05ef5d4027 admin admin] PATH_INFO: `/v3/projects/63b38785fea842a1bc235f70f53cc28c/users/f188308b35af4a0ab1e341ee65a82e92/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:46.811790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065eff-ffaf-48d3-bd3d-5a05ef5d4027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b38785fea842a1bc235f70f53cc28c, user_id=f188308b35af4a0ab1e341ee65a82e92, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:46.818554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065eff-ffaf-48d3-bd3d-5a05ef5d4027 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:46.837472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:46.854109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 911/1793] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:46 2022] POST /identity/v3/users => generated 285 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:46.854739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 883/1794] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:46 2022] PUT /identity/v3/projects/63b38785fea842a1bc235f70f53cc28c/users/f188308b35af4a0ab1e341ee65a82e92/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:46.855674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:46.866483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:46.866839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:46.867402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:46.885821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4062dc-0992-41a9-b2bf-398891b0313d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:46.958590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] MFA Rules not processed for user `f188308b35af4a0ab1e341ee65a82e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:46.971861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:47.132370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:47.133069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:47.133356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:47.133642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:47.136616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:47.142940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:47.165277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 912/1795] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:47.170515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:47.198159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab64f78-d771-42f1-a6a4-30d83674fc93 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:47.213542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:47.214233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:47.214530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:47.215504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] PATH_INFO: `/v3/projects/c1019659082e4a3d97eeb53fa42398a1/users/bb319b1409ac4b83b901476590598f73/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:47.237380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1019659082e4a3d97eeb53fa42398a1, user_id=bb319b1409ac4b83b901476590598f73, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:47.240320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:47.279993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 913/1796] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:47 2022] PUT /identity/v3/projects/c1019659082e4a3d97eeb53fa42398a1/users/bb319b1409ac4b83b901476590598f73/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:47.284223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:47.318829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 884/1797] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:47.327557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:47.331326 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:47.519632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfbea5-40c4-4a27-9c45-50056bc38c20 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:47.599927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdd000-e51b-4d2a-9df9-6a69f652a04a admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:47.624841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:47.625655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:47.625945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:47.626227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:47.626934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:47.630260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:47.667922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 914/1798] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:47.669208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:47.674161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:47.693774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239e5a-0049-4259-a551-36273a99f213 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:47.704197 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:47.705371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:47.705852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:47.706629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] PATH_INFO: `/v3/projects/9de6ab0102424f268039980785f8f554` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:47.708192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de6ab0102424f268039980785f8f554)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:47.712706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:47.739684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:47.740589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:47.741033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:47.741575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:47.797096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:47.820824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de6ab0102424f268039980785f8f554', 'request_id': 'req-a1702b96-22d9-4739-8a0d-361028346e7b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:47.829353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de6ab0102424f268039980785f8f554', 'request_id': 'req-a1702b96-22d9-4739-8a0d-361028346e7b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:47.839912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de6ab0102424f268039980785f8f554', 'request_id': 'req-a1702b96-22d9-4739-8a0d-361028346e7b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:47.857549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:47.865867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] The token cache is being invalidate because project 9de6ab0102424f268039980785f8f554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:47.868162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:47.869618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:47.876912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 915/1799] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:47 2022] DELETE /identity/v3/projects/9de6ab0102424f268039980785f8f554 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:47.877224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:47.877224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:47.877399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:47.880454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:47.909981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 885/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:47.911159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:47.949048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef52c56-745b-472d-a564-e040a9b7e605 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:48.039937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702b96-22d9-4739-8a0d-361028346e7b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:48.072299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7a38f-373b-46ef-a2ce-d5244d72aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:48.079099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a38f-373b-46ef-a2ce-d5244d72aa15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:48.080434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a38f-373b-46ef-a2ce-d5244d72aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:48.081698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7a38f-373b-46ef-a2ce-d5244d72aa15 admin admin] PATH_INFO: `/v3/projects/c1019659082e4a3d97eeb53fa42398a1/users/bb319b1409ac4b83b901476590598f73/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:48.087803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7a38f-373b-46ef-a2ce-d5244d72aa15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1019659082e4a3d97eeb53fa42398a1, user_id=bb319b1409ac4b83b901476590598f73, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:48.098770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7a38f-373b-46ef-a2ce-d5244d72aa15 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:48.115552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:48.118958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:48.119417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:48.120379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] PATH_INFO: `/v3/users/25a4917debf844039bfeaf9fdb0bff72` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:48.128908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a4917debf844039bfeaf9fdb0bff72)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:48.131478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:48.158595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 916/1801] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:47 2022] PUT /identity/v3/projects/c1019659082e4a3d97eeb53fa42398a1/users/bb319b1409ac4b83b901476590598f73/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:48.170360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd344d-8f48-486f-a088-94c4bbbb8cdc None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:48.170684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd344d-8f48-486f-a088-94c4bbbb8cdc None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:48.171141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd344d-8f48-486f-a088-94c4bbbb8cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:48.265759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a4917debf844039bfeaf9fdb0bff72'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:48.266824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a4917debf844039bfeaf9fdb0bff72'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:48.268728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a4917debf844039bfeaf9fdb0bff72'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:48.288182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a4917debf844039bfeaf9fdb0bff72'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:48.305236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a4917debf844039bfeaf9fdb0bff72'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:48.312182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-23cd344d-8f48-486f-a088-94c4bbbb8cdc None None] MFA Rules not processed for user `bb319b1409ac4b83b901476590598f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:48.320063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-23cd344d-8f48-486f-a088-94c4bbbb8cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:48.336003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 886/1802] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:47 2022] DELETE /identity/v3/users/25a4917debf844039bfeaf9fdb0bff72 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:48.541844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 917/1803] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:48.594690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:48.599022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:48.794998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4cc36-f7c7-4892-b2ab-1cf56635ea94 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:48.813152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:48.814318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:48.814318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:48.814539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:48.894116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:48.990531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:48.992125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:49.016357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 887/1804] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:38:49.405278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd344d-8f48-486f-a088-94c4bbbb8cdc None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:49.493169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:49.506834 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd344d-8f48-486f-a088-94c4bbbb8cdc None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:49.512089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e968ba0-de2b-48c3-be3b-cf1c05dbea74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:49.512779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968ba0-de2b-48c3-be3b-cf1c05dbea74 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:49.513225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968ba0-de2b-48c3-be3b-cf1c05dbea74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:49.513674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e968ba0-de2b-48c3-be3b-cf1c05dbea74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:49.517792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0e968ba0-de2b-48c3-be3b-cf1c05dbea74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:49.540302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:49.541734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:49.730294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e968ba0-de2b-48c3-be3b-cf1c05dbea74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:49.734091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e968ba0-de2b-48c3-be3b-cf1c05dbea74 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:49.760710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 918/1805] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:49.768243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f02b-abac-4cd6-a2e2-00ac45c933c6 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:49.774920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:49.776459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:49.776749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:49.777875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] PATH_INFO: `/v3/projects/e68ead21491d457abcaf5c403e58186c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:49.779086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68ead21491d457abcaf5c403e58186c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:49.784672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:49.966928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68ead21491d457abcaf5c403e58186c', 'request_id': 'req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:49.991919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68ead21491d457abcaf5c403e58186c', 'request_id': 'req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:50.036265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68ead21491d457abcaf5c403e58186c', 'request_id': 'req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:50.065056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] The token cache is being invalidate because project e68ead21491d457abcaf5c403e58186c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:50.065489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:50.069056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4eabe5a6-7641-433f-8ee8-bccd208ddcc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:50.076082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 888/1806] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:49 2022] DELETE /identity/v3/projects/e68ead21491d457abcaf5c403e58186c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:50.077653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1334f-60e1-427f-9a06-994a6d36f42e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:50.078762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1334f-60e1-427f-9a06-994a6d36f42e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:50.079438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1334f-60e1-427f-9a06-994a6d36f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:50.145105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-25a1334f-60e1-427f-9a06-994a6d36f42e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:50.149924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-25a1334f-60e1-427f-9a06-994a6d36f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:50.383757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 919/1807] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:50.391740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be69d41-aebc-42c5-a6ec-c55ff260c5a0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:50.392039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be69d41-aebc-42c5-a6ec-c55ff260c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:50.392324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be69d41-aebc-42c5-a6ec-c55ff260c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:50.437849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6be69d41-aebc-42c5-a6ec-c55ff260c5a0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:50.439255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6be69d41-aebc-42c5-a6ec-c55ff260c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:50.471952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 889/1808] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:50.477994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1334f-60e1-427f-9a06-994a6d36f42e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:50.508872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1334f-60e1-427f-9a06-994a6d36f42e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:50.532305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:50.533212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:50.535988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:50.536443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:50.537283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:50.541165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:50.543028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:50.583667 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 920/1809] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:50.586296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be69d41-aebc-42c5-a6ec-c55ff260c5a0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:50.599090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be69d41-aebc-42c5-a6ec-c55ff260c5a0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:50.615022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef1b71-14fe-41e9-aed7-838a2ab86dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:50.616474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef1b71-14fe-41e9-aed7-838a2ab86dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:50.617150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef1b71-14fe-41e9-aed7-838a2ab86dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:50.618799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef1b71-14fe-41e9-aed7-838a2ab86dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:50.620513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef1b71-14fe-41e9-aed7-838a2ab86dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:50.625863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef1b71-14fe-41e9-aed7-838a2ab86dc5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:50.690593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 890/1810] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:50 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:50.695355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:50.719477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b4dc-35eb-4dc4-9edc-0cb554225ee9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:50.750896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96c8f-837c-4281-b88c-44c930f2eecf None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:50.754169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96c8f-837c-4281-b88c-44c930f2eecf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:50.754169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96c8f-837c-4281-b88c-44c930f2eecf None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:50.754169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 891/1811] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:38:50.888032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675ae23-ed9d-4ca7-897f-a0407fc2d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:50.888654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae23-ed9d-4ca7-897f-a0407fc2d861 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:50.889010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae23-ed9d-4ca7-897f-a0407fc2d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:50.889668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae23-ed9d-4ca7-897f-a0407fc2d861 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:50.896789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675ae23-ed9d-4ca7-897f-a0407fc2d861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:50.909276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675ae23-ed9d-4ca7-897f-a0407fc2d861 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:50.975017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 921/1812] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:50 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:50.979138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada96c8f-837c-4281-b88c-44c930f2eecf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:51.007432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada96c8f-837c-4281-b88c-44c930f2eecf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:51.025287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:51.026889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:51.028560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:51.029117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:51.030191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:51.032342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:51.058865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7bddc-d161-4374-96f9-9e543bf07eb4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:51.059163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7bddc-d161-4374-96f9-9e543bf07eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:51.059448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7bddc-d161-4374-96f9-9e543bf07eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:51.100916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 892/1813] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:51.102996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:51.134603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-95a7bddc-d161-4374-96f9-9e543bf07eb4 None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:51.139477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-95a7bddc-d161-4374-96f9-9e543bf07eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:51.146126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05431ae-90c9-4dfc-8561-8a31c54c82fa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:51.158794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:51.161133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:51.163058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:51.163649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:51.164572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:51.173679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:51.183467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:51.204708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:51.222260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 893/1814] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:51.227627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:51.262607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ad6a-46e5-494d-823c-1218d6c93124 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:51.273878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd65c0-3dea-4477-94f7-a8ebc957bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:51.274564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd65c0-3dea-4477-94f7-a8ebc957bb74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:51.275039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd65c0-3dea-4477-94f7-a8ebc957bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:51.275472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd65c0-3dea-4477-94f7-a8ebc957bb74 admin admin] PATH_INFO: `/v3/projects/57029ed38cc84bb3afa5a5c032091795/users/87e3add558c0486ab4da4dd8bb7fa127/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:51.311884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd65c0-3dea-4477-94f7-a8ebc957bb74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57029ed38cc84bb3afa5a5c032091795, user_id=87e3add558c0486ab4da4dd8bb7fa127, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:51.316449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd65c0-3dea-4477-94f7-a8ebc957bb74 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:51.346255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 894/1815] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:51 2022] PUT /identity/v3/projects/57029ed38cc84bb3afa5a5c032091795/users/87e3add558c0486ab4da4dd8bb7fa127/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:51.361191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:51.362219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:51.362733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:51.444282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] MFA Rules not processed for user `87e3add558c0486ab4da4dd8bb7fa127`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:51.444282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:51.462872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 922/1816] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:38:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:51.617420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 895/1817] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:51.618122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7bddc-d161-4374-96f9-9e543bf07eb4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:51.638506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7bddc-d161-4374-96f9-9e543bf07eb4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:51.674902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:51.684757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:51.784766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:51.785400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:51.785671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:51.785952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:51.786719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:51.790604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:51.876864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 923/1818] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:51 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:51.880253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:51.881505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485147-7f70-4991-8742-505d82ed8890 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:52.080704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:52.101340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ad822-d959-4d8c-8536-4f4cb9195f59 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:52.107822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:52.108226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:52.108559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:52.108830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:52.108946 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:52.109025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:52.109106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:52.109693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:52.110831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:52.113501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:52.151342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:52.153174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:52.166739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 896/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:52.176346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 924/1820] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:51 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:52.179617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:52.219635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e1db7-a282-4d35-b4a2-a6c71d8c3b68 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:52.239383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:52.239939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:52.240223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:52.240499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:52.245095 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:52.246721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:52.284596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 897/1821] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:52.287894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:52.308372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955031-84e1-4f3f-86ae-5e684ff42f30 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:52.328716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:52.332142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:52.333074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:52.334072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] PATH_INFO: `/v3/projects/228c35e80a3f4cc28e788545402b309a/users/fc6a9ac5e0eb430cb651a8eb4e987ae1/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:52.381919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228c35e80a3f4cc28e788545402b309a, user_id=fc6a9ac5e0eb430cb651a8eb4e987ae1, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:52.394458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:52.408747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:52.428643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:52.429099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 925/1822] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:52 2022] PUT /identity/v3/projects/228c35e80a3f4cc28e788545402b309a/users/fc6a9ac5e0eb430cb651a8eb4e987ae1/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:52.444908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201c87-4c05-405c-89fa-cb73be998885 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:52.637206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717baea-ece4-474f-a149-a0e5fccbf6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:52.637890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717baea-ece4-474f-a149-a0e5fccbf6da admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:52.638110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717baea-ece4-474f-a149-a0e5fccbf6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:52.638390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717baea-ece4-474f-a149-a0e5fccbf6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:52.639295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717baea-ece4-474f-a149-a0e5fccbf6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:52.644551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717baea-ece4-474f-a149-a0e5fccbf6da admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:52.687092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:52.700411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec606e-090d-4659-b5ad-9c18fb28c754 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:52.701484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 898/1823] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:52.716235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:52.716992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:52.717290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:52.717577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] PATH_INFO: `/v3/projects/228c35e80a3f4cc28e788545402b309a/users/fc6a9ac5e0eb430cb651a8eb4e987ae1/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:52.720634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228c35e80a3f4cc28e788545402b309a, user_id=fc6a9ac5e0eb430cb651a8eb4e987ae1, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:52.724092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:52.774210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:52.774521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:52.775087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:52.777787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 926/1824] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:52 2022] PUT /identity/v3/projects/228c35e80a3f4cc28e788545402b309a/users/fc6a9ac5e0eb430cb651a8eb4e987ae1/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:52.841081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] MFA Rules not processed for user `fc6a9ac5e0eb430cb651a8eb4e987ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:52.842882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:52.957513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:52.959280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:53.075299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 899/1825] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:53.137043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55e2c7-aa2a-45a6-a00d-bcfac57be910 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:53.157981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:53.158660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:53.158948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:53.159231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] PATH_INFO: `/v3/users/008a4737863d4d91ba565b0fda65cfa0` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:53.163548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008a4737863d4d91ba565b0fda65cfa0)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:53.174778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:53.242233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:53.243726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:53.332542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008a4737863d4d91ba565b0fda65cfa0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:53.333865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008a4737863d4d91ba565b0fda65cfa0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:53.361585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008a4737863d4d91ba565b0fda65cfa0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:53.377443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008a4737863d4d91ba565b0fda65cfa0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:53.378435 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b1ed3588-2a2d-464a-8702-2f2fb802c651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008a4737863d4d91ba565b0fda65cfa0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:53.400228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 927/1826] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:52 2022] DELETE /identity/v3/users/008a4737863d4d91ba565b0fda65cfa0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:53.404498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:53.405502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:53.405881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:53.455530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016552cb-2fdd-4ef5-8ce6-20bf77f33de9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:53.480416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:53.485081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:53.488219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:53.586146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adad7a-7099-49c6-afe4-6e0c7b6915bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:53.586826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adad7a-7099-49c6-afe4-6e0c7b6915bd service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:53.587115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adad7a-7099-49c6-afe4-6e0c7b6915bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:53.587964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adad7a-7099-49c6-afe4-6e0c7b6915bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:53.607107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57adad7a-7099-49c6-afe4-6e0c7b6915bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:53.617251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 928/1827] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:53.626608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:53.632234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:53.638124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:53.798742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61ed3a-7e6d-41bc-bb58-5e25a76f4fb4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:53.814929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:53.815607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:53.815900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:53.816173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:53.852930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:53.857394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:53.883032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adad7a-7099-49c6-afe4-6e0c7b6915bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:53.884802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adad7a-7099-49c6-afe4-6e0c7b6915bd service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:53.885896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 929/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:53.925214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 900/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:38:54.247099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:54.249847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:54.274252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8d363-a5db-4d17-95a2-56e36b07341e service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:54.289063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:54.289889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:54.290280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:54.290762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] PATH_INFO: `/v3/users/398d7a29e3ce494f8f719fc94795037f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:54.294065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=398d7a29e3ce494f8f719fc94795037f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:54.302833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:54.427124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398d7a29e3ce494f8f719fc94795037f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:54.428130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398d7a29e3ce494f8f719fc94795037f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:54.454523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398d7a29e3ce494f8f719fc94795037f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:54.472802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398d7a29e3ce494f8f719fc94795037f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:54.474083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398d7a29e3ce494f8f719fc94795037f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:54.505542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 930/1830] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:54 2022] DELETE /identity/v3/users/398d7a29e3ce494f8f719fc94795037f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:54.506619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:54.506934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:54.507246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:54.541049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:54.542863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:54.635316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 901/1831] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:54.662077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:54.665870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:54.827747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebd0f7-0b05-46b9-b00b-875d01c8fb8d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:54.833231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a785e09-cef5-449f-a06a-175c3bb78505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:54.834176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a785e09-cef5-449f-a06a-175c3bb78505 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:54.834497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a785e09-cef5-449f-a06a-175c3bb78505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:54.834776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a785e09-cef5-449f-a06a-175c3bb78505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:54.848169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a785e09-cef5-449f-a06a-175c3bb78505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:54.849989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a785e09-cef5-449f-a06a-175c3bb78505 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:54.869012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 931/1832] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:54.898533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:54.900141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:54.917700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83533f-aec0-4663-90c2-d03759ace2f0 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:54.917700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83533f-aec0-4663-90c2-d03759ace2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:54.917700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83533f-aec0-4663-90c2-d03759ace2f0 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:54.918938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 932/1833] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:38:54.935191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780dc21-4282-4880-b04a-6dcd00b2cc2c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:54.935522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780dc21-4282-4880-b04a-6dcd00b2cc2c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:54.936377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780dc21-4282-4880-b04a-6dcd00b2cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:54.971619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c780dc21-4282-4880-b04a-6dcd00b2cc2c None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:54.972753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c780dc21-4282-4880-b04a-6dcd00b2cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.031901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77371b-3371-48ec-815a-9ec5d1ed9a8d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.034874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:55.040391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a9ac5e0eb430cb651a8eb4e987ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '228c35e80a3f4cc28e788545402b309a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.041285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.042137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.042561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.043440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:55.043951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.048143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.059700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:55.067254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 902/1834] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:55.067254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.073577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.094572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74f3bf-c09d-4125-be67-9497cbb1e0b1 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.100367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.101200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.101564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.102115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] PATH_INFO: `/v3/projects/12995ea64493480ab2dc737d9366dc34` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.104194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12995ea64493480ab2dc737d9366dc34)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.106833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.156555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 933/1835] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:38:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:55.157717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780dc21-4282-4880-b04a-6dcd00b2cc2c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.174269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780dc21-4282-4880-b04a-6dcd00b2cc2c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.178975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12995ea64493480ab2dc737d9366dc34', 'request_id': 'req-0cf7648a-f73d-41a7-b7fb-786d461a57dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.187631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12995ea64493480ab2dc737d9366dc34', 'request_id': 'req-0cf7648a-f73d-41a7-b7fb-786d461a57dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.198606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12995ea64493480ab2dc737d9366dc34', 'request_id': 'req-0cf7648a-f73d-41a7-b7fb-786d461a57dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.214063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] The token cache is being invalidate because project 12995ea64493480ab2dc737d9366dc34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:55.214411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.215166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.218311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 903/1836] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:55 2022] DELETE /identity/v3/projects/12995ea64493480ab2dc737d9366dc34 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:55.219095 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.220612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.256567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a9ac5e0eb430cb651a8eb4e987ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '228c35e80a3f4cc28e788545402b309a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.257192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.257486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.257752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.258419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.260374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.297293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 934/1837] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:55 2022] POST /identity/v3/projects => generated 352 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:55.297293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.299676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.320106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7648a-f73d-41a7-b7fb-786d461a57dc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.369724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45bf36-005c-4410-ad8c-36bb2fe84a91 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.374874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.375673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.375978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.376343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] PATH_INFO: `/v3/users/b320a232f3bd4648897894e5fd474f39` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.377934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b320a232f3bd4648897894e5fd474f39)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.379729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.393317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.393950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.394371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.394777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.396828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.410614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.412510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.433151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:55.438174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 904/1838] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:55.439019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.442446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b320a232f3bd4648897894e5fd474f39'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.442829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.443320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b320a232f3bd4648897894e5fd474f39'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.456065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:55.470989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b320a232f3bd4648897894e5fd474f39'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.484739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b320a232f3bd4648897894e5fd474f39'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.485596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b320a232f3bd4648897894e5fd474f39'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.514547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 935/1839] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:55 2022] DELETE /identity/v3/users/b320a232f3bd4648897894e5fd474f39 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:55.516548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.520594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.549210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0f677-0367-42a4-8c34-6fc296f05585 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.642416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52d041-f184-4eb8-a2bb-87be0a80f679 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.664341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.664787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.665372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.665696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] PATH_INFO: `/v3/projects/7c12f82065ac424dab0b5ba85b2d1a1c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.667778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c12f82065ac424dab0b5ba85b2d1a1c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.670069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.705672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a9ac5e0eb430cb651a8eb4e987ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '228c35e80a3f4cc28e788545402b309a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.705926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.706122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.706367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.707044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:55.708743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.710245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.733199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 905/1840] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:55.754576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c12f82065ac424dab0b5ba85b2d1a1c', 'request_id': 'req-5a74bce0-dafd-414e-a806-13937aa36f3d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.763000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c12f82065ac424dab0b5ba85b2d1a1c', 'request_id': 'req-5a74bce0-dafd-414e-a806-13937aa36f3d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.773638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c12f82065ac424dab0b5ba85b2d1a1c', 'request_id': 'req-5a74bce0-dafd-414e-a806-13937aa36f3d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.794600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.796771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.808919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] The token cache is being invalidate because project 7c12f82065ac424dab0b5ba85b2d1a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:55.810264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.811241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:55.814481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ea26a-be3c-40c4-aefb-c6c9e863ca71 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.816431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 936/1841] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:55 2022] DELETE /identity/v3/projects/7c12f82065ac424dab0b5ba85b2d1a1c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:55.820360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:55.822412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:55.917119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:55.969103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6a9ac5e0eb430cb651a8eb4e987ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '228c35e80a3f4cc28e788545402b309a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.969103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.969103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.969747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] PATH_INFO: `/v3/projects/78f9ff0a1ed54ad787c952fd3cc9b47d` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.969747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78f9ff0a1ed54ad787c952fd3cc9b47d)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.969747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:55.980176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74bce0-dafd-414e-a806-13937aa36f3d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:55.983417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:55.984489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:55.984779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:55.985059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] PATH_INFO: `/v3/users/f188308b35af4a0ab1e341ee65a82e92` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:55.989707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f188308b35af4a0ab1e341ee65a82e92)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:55.991777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:56.090473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f9ff0a1ed54ad787c952fd3cc9b47d', 'request_id': 'req-e4d57dd2-b31c-4949-85e9-877ea05ea325'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.093289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:56.105964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f9ff0a1ed54ad787c952fd3cc9b47d', 'request_id': 'req-e4d57dd2-b31c-4949-85e9-877ea05ea325'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.125681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f9ff0a1ed54ad787c952fd3cc9b47d', 'request_id': 'req-e4d57dd2-b31c-4949-85e9-877ea05ea325'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.140153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] The token cache is being invalidate because project 78f9ff0a1ed54ad787c952fd3cc9b47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:56.141397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f188308b35af4a0ab1e341ee65a82e92'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.144590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.145141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f188308b35af4a0ab1e341ee65a82e92'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.145900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.151138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 906/1842] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:55 2022] DELETE /identity/v3/projects/78f9ff0a1ed54ad787c952fd3cc9b47d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:56.174883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f188308b35af4a0ab1e341ee65a82e92'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.189158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f188308b35af4a0ab1e341ee65a82e92'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.189917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f188308b35af4a0ab1e341ee65a82e92'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.226434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 937/1843] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:55 2022] DELETE /identity/v3/users/f188308b35af4a0ab1e341ee65a82e92 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:56.488575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:56.490404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:56.657366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d57dd2-b31c-4949-85e9-877ea05ea325 tempest-VolumeQuotaClassesTest-2129745617 tempest-VolumeQuotaClassesTest-2129745617-project-admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:56.724481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:56.726160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:56.803694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:56.805515 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:56.806061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:56.806603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] PATH_INFO: `/v3/projects/7701e930fbef4e1fbec92a555730a6aa` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:56.809855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7701e930fbef4e1fbec92a555730a6aa)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:56.812669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:56.895584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfbbb9-7864-414c-b690-a29724680c58 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:56.937619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7701e930fbef4e1fbec92a555730a6aa', 'request_id': 'req-b9d27c12-efb0-4bcf-9e99-88501139969a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.953497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7701e930fbef4e1fbec92a555730a6aa', 'request_id': 'req-b9d27c12-efb0-4bcf-9e99-88501139969a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.968500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7701e930fbef4e1fbec92a555730a6aa', 'request_id': 'req-b9d27c12-efb0-4bcf-9e99-88501139969a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.985702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] The token cache is being invalidate because project 7701e930fbef4e1fbec92a555730a6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:56.986284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.987298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b9d27c12-efb0-4bcf-9e99-88501139969a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:56.992396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 907/1844] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:56 2022] DELETE /identity/v3/projects/7701e930fbef4e1fbec92a555730a6aa => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:56.997583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:56.998740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.000005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.003409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.004165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.004717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.005069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] PATH_INFO: `/v3/users/87e3add558c0486ab4da4dd8bb7fa127` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.006317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e3add558c0486ab4da4dd8bb7fa127)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.008523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.031058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:57.032446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:57.034048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.044545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 908/1845] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:57.047109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.047984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.070463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a74f-d0db-4426-9586-1da8164e6a3a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.076432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.077337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.077577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.077862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] PATH_INFO: `/v3/projects/63b38785fea842a1bc235f70f53cc28c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.079484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b38785fea842a1bc235f70f53cc28c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.081268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.083946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:57.109708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e3add558c0486ab4da4dd8bb7fa127'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.110539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e3add558c0486ab4da4dd8bb7fa127'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.133613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e3add558c0486ab4da4dd8bb7fa127'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.144837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e3add558c0486ab4da4dd8bb7fa127'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.145495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3d8b18ef-9397-4b11-91ed-512d953ff344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e3add558c0486ab4da4dd8bb7fa127'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.148270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b38785fea842a1bc235f70f53cc28c', 'request_id': 'req-76954ad8-7aac-487a-91cd-2aebbe3e1585'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.154447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b38785fea842a1bc235f70f53cc28c', 'request_id': 'req-76954ad8-7aac-487a-91cd-2aebbe3e1585'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.161772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 938/1846] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:56 2022] DELETE /identity/v3/users/87e3add558c0486ab4da4dd8bb7fa127 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:57.163126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82009204-96f4-44ad-9e2f-5aaf998f5d7b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.163528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82009204-96f4-44ad-9e2f-5aaf998f5d7b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.163929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82009204-96f4-44ad-9e2f-5aaf998f5d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.166404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b38785fea842a1bc235f70f53cc28c', 'request_id': 'req-76954ad8-7aac-487a-91cd-2aebbe3e1585'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.183718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] The token cache is being invalidate because project 63b38785fea842a1bc235f70f53cc28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:57.184039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.185257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-76954ad8-7aac-487a-91cd-2aebbe3e1585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:57.187653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 909/1847] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:57 2022] DELETE /identity/v3/projects/63b38785fea842a1bc235f70f53cc28c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:57.188748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-82009204-96f4-44ad-9e2f-5aaf998f5d7b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:57.188943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d02a1-ec85-4976-b069-49e0e5b7c437 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.189239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d02a1-ec85-4976-b069-49e0e5b7c437 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.189498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d02a1-ec85-4976-b069-49e0e5b7c437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.190462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-82009204-96f4-44ad-9e2f-5aaf998f5d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.219789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e45d02a1-ec85-4976-b069-49e0e5b7c437 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:57.221002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e45d02a1-ec85-4976-b069-49e0e5b7c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.263753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 939/1848] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:57.265351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9045a-30d5-4955-bfc2-21698a57e6bf None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.265802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9045a-30d5-4955-bfc2-21698a57e6bf None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.266559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9045a-30d5-4955-bfc2-21698a57e6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.286246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b6c9045a-30d5-4955-bfc2-21698a57e6bf None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:57.287515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b6c9045a-30d5-4955-bfc2-21698a57e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.292301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 910/1849] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:57.293122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d02a1-ec85-4976-b069-49e0e5b7c437 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.296815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 940/1850] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:57.305411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb94cb-a5b7-4268-a291-96f737055fef None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.305773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb94cb-a5b7-4268-a291-96f737055fef None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.306172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb94cb-a5b7-4268-a291-96f737055fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.314103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d02a1-ec85-4976-b069-49e0e5b7c437 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.320000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.320619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.320905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.321177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.321835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:57.322141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.324264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.328600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-22cb94cb-a5b7-4268-a291-96f737055fef None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:57.329829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-22cb94cb-a5b7-4268-a291-96f737055fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.336817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 911/1851] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:57.338530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 941/1852] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:57.340532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.342849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.343185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb94cb-a5b7-4268-a291-96f737055fef None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.354262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb94cb-a5b7-4268-a291-96f737055fef None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.360030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.360717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.361216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.361567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.362276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.364792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.396514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 942/1853] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:57.400488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.407039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64dd70-a3f0-4c6e-8573-dbf4885129c5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.440494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:57.459663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.460279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.460562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.460836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.461937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:57.465940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c5ef-bd2a-4e2f-84a6-d5c86e1b5bd5 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.471396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.472662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.473322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.473455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.473639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.474236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.475174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:38:57.475816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.477425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.484468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 912/1854] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:38:57.485059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.493087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 943/1855] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:38:57.494060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.497239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275c96-67d7-473a-bab0-daa953d8ab50 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.504510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.505334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.505607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.505990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.506598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1217cba-72c3-467d-94c4-ab7ceee89272 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.506763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.509223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.512348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.513029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.513680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.513680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.514677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.516834 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.536745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 913/1856] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/users => generated 282 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:57.540618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.549138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 944/1857] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:57.552861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.556577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e35116-5d82-4bf2-a93a-8a05e57d2b1e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.675145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.676321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.677866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.679659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.682562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.687435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.709374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 914/1858] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:57.713684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.725915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a387-0f6d-4f53-bda4-ed92aebe3c47 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.728639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2317ed4-f2ac-4af3-a304-0962bda86437 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.735036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.736208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.736683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.737167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.738007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.739842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.740321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.741054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.741516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.743553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.744450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.749761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.762004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 915/1859] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:57.766549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.787271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 945/1860] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:57.791043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.810266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c683259-2d7e-4f8b-b43c-5bbbe0007d83 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.819630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5f4a-f55c-430b-99bc-35dfd1d0df8b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.822748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad552fb4-1610-4c7b-9602-d9d16e4a6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.824281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552fb4-1610-4c7b-9602-d9d16e4a6a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.824626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552fb4-1610-4c7b-9602-d9d16e4a6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.825023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552fb4-1610-4c7b-9602-d9d16e4a6a2a admin admin] PATH_INFO: `/v3/projects/5feb36ed22174a598e148ec3e56d9d7e/users/bceb20c1b94c400fa06d4bf78ed4942a/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.831907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.833870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.834238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.835988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.836753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.843955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.856323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad552fb4-1610-4c7b-9602-d9d16e4a6a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5feb36ed22174a598e148ec3e56d9d7e, user_id=bceb20c1b94c400fa06d4bf78ed4942a, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:57.866802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad552fb4-1610-4c7b-9602-d9d16e4a6a2a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:57.867430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 946/1861] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:57.872819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:57.895036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700dd5-a405-4a25-a893-3a91013a4445 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:57.899232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 916/1862] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:57 2022] PUT /identity/v3/projects/5feb36ed22174a598e148ec3e56d9d7e/users/bceb20c1b94c400fa06d4bf78ed4942a/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:57.910937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4265f5-1734-43ee-a663-f94382698540 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.911272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4265f5-1734-43ee-a663-f94382698540 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.911559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4265f5-1734-43ee-a663-f94382698540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.964886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8a4265f5-1734-43ee-a663-f94382698540 None None] MFA Rules not processed for user `bceb20c1b94c400fa06d4bf78ed4942a`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:57.966346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a4265f5-1734-43ee-a663-f94382698540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:57.996105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:57.996873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:57.997247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:57.997617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:57.999338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.001986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.031977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 947/1863] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:58.033319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.049401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32d669-cc6e-4302-9ed1-79fdf35178b0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.057091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6609fed-1295-4c46-b73f-e458e2e79769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.057892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6609fed-1295-4c46-b73f-e458e2e79769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.058295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6609fed-1295-4c46-b73f-e458e2e79769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.058670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6609fed-1295-4c46-b73f-e458e2e79769 admin admin] PATH_INFO: `/v3/projects/a470b500efbb4184b23e0f3a1be1bbc6/users/f6335bfc18954bd38928aab68e0bfe97/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.081157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6609fed-1295-4c46-b73f-e458e2e79769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a470b500efbb4184b23e0f3a1be1bbc6, user_id=f6335bfc18954bd38928aab68e0bfe97, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.084204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6609fed-1295-4c46-b73f-e458e2e79769 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.128879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 948/1864] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:58 2022] PUT /identity/v3/projects/a470b500efbb4184b23e0f3a1be1bbc6/users/f6335bfc18954bd38928aab68e0bfe97/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:58.145143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.145476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.145711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.158464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 917/1865] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:58.159372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4265f5-1734-43ee-a663-f94382698540 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.183029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4265f5-1734-43ee-a663-f94382698540 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.200810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:58.223905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] MFA Rules not processed for user `f6335bfc18954bd38928aab68e0bfe97`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:58.225485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:58.260084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:58.349748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.350526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.350917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.352708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.353536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.359351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.390207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 949/1866] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:58.395167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.396596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:58.421754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 918/1867] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:58 2022] POST /identity/v3/projects => generated 363 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:58.422694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.427384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b42e70-ec0b-4ff4-bda2-7a02c388a2ae None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.513573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0a241-5384-498d-8dbf-2acc8cd75118 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.524675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.525629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.525979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.526504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.527523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.530995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.573179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 919/1868] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:38:58 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:58.574415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.585635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.586562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.586850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.587134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] PATH_INFO: `/v3/projects/57029ed38cc84bb3afa5a5c032091795` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.588454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] RBAC: Authorizing `identity:delete_project(project_id=57029ed38cc84bb3afa5a5c032091795)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.590905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.658683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57029ed38cc84bb3afa5a5c032091795', 'request_id': 'req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.668804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57029ed38cc84bb3afa5a5c032091795', 'request_id': 'req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.675088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec720885-dc7e-4681-91b9-73788e2f57ec admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.678340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57029ed38cc84bb3afa5a5c032091795', 'request_id': 'req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.693349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] The token cache is being invalidate because project 57029ed38cc84bb3afa5a5c032091795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:38:58.693680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.694363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.695943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 950/1869] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:58 2022] DELETE /identity/v3/projects/57029ed38cc84bb3afa5a5c032091795 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:58.697271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.698662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:58.706141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:58.739345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.739907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.740189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.740464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.741102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.743028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.743988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:58.765130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 920/1870] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:58 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:58.766087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.767929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:58.770200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc6b3-4c0e-41d5-8c0e-2299a5d1ceae admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.775039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.775664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.775951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.776220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.776848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.778768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.780545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633ba47-f732-4c04-8156-20a6c9e11046 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.786204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.786874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.787160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.787448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] PATH_INFO: `/v3/users/fc6a9ac5e0eb430cb651a8eb4e987ae1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.788811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6a9ac5e0eb430cb651a8eb4e987ae1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.790627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.806985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 951/1871] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:38:58 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:38:58.807983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.811823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:58.832576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43a75d-5605-4fd1-b56b-ac4cec90cbd3 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.841344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.842841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.843125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.843444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.844260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.846150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.856902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6a9ac5e0eb430cb651a8eb4e987ae1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.858359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6a9ac5e0eb430cb651a8eb4e987ae1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.859041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6a9ac5e0eb430cb651a8eb4e987ae1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.860573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 952/1872] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:58.861510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.863670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:58.868234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6a9ac5e0eb430cb651a8eb4e987ae1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.880127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256ad29-16d7-49bb-b9db-522eb72b8582 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:58.882535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6a9ac5e0eb430cb651a8eb4e987ae1'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:38:58.885520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:58.885957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:58.886305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:58.886649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:58.887361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:58.890512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:58.906072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 953/1873] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:38:58.906072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.911391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:58.913800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 921/1874] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:38:58 2022] DELETE /identity/v3/users/fc6a9ac5e0eb430cb651a8eb4e987ae1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:58.914667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:58.929173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e52fc-7d49-426e-9e61-70d7ec645cc2 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.003890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a409-884e-43ee-93f6-e7747edbaeda admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.011101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.011834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.012170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.013325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] PATH_INFO: `/v3/projects/c017aab66e144027af0cbf82e4e3ba19/users/5de8013869e74ec2a760ec57c0c1da2f/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.023107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.024172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.024649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.025112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] PATH_INFO: `/v3/projects/b7465678d590418b9624c483c16a19d0/users/8c61e3ec1d0741f2a6e99068c0acd465/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.039146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c017aab66e144027af0cbf82e4e3ba19, user_id=5de8013869e74ec2a760ec57c0c1da2f, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:59.043346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:59.063264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 922/1875] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:58 2022] PUT /identity/v3/projects/c017aab66e144027af0cbf82e4e3ba19/users/5de8013869e74ec2a760ec57c0c1da2f/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:59.065287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:59.065920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7465678d590418b9624c483c16a19d0, user_id=8c61e3ec1d0741f2a6e99068c0acd465, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:59.070794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:59.090993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:59.106191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 954/1876] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:58 2022] PUT /identity/v3/projects/b7465678d590418b9624c483c16a19d0/users/8c61e3ec1d0741f2a6e99068c0acd465/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:38:59.111090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:59.175253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1c173-78fc-4a5f-a321-36b8a224c540 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.263497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90439ba0-064f-4b6a-91bb-f555623e15d9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.265107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.266302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.267722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.268296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.270492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:59.275079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:59.283426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.284276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.284711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.292172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.293044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:59.296497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:59.306214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 923/1877] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:38:59.311265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:59.320323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 955/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:38:59.324786 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:59.340548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72147168-905e-4696-9e6f-5dd4a0ee9841 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.342805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224512fd-d597-49b7-b896-58238c536db0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.347727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249d919-7d94-4b57-bd9e-1afb050ce4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.348332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249d919-7d94-4b57-bd9e-1afb050ce4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.355863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249d919-7d94-4b57-bd9e-1afb050ce4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.355863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249d919-7d94-4b57-bd9e-1afb050ce4d5 admin admin] PATH_INFO: `/v3/projects/b7465678d590418b9624c483c16a19d0/users/8c61e3ec1d0741f2a6e99068c0acd465/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.355863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249d919-7d94-4b57-bd9e-1afb050ce4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7465678d590418b9624c483c16a19d0, user_id=8c61e3ec1d0741f2a6e99068c0acd465, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:59.355863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249d919-7d94-4b57-bd9e-1afb050ce4d5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:59.360445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4419e1-f7d4-403f-be3a-dd6714fa70a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.361339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4419e1-f7d4-403f-be3a-dd6714fa70a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.361767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4419e1-f7d4-403f-be3a-dd6714fa70a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.362141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4419e1-f7d4-403f-be3a-dd6714fa70a7 admin admin] PATH_INFO: `/v3/projects/c017aab66e144027af0cbf82e4e3ba19/users/5de8013869e74ec2a760ec57c0c1da2f/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.364827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4419e1-f7d4-403f-be3a-dd6714fa70a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c017aab66e144027af0cbf82e4e3ba19, user_id=5de8013869e74ec2a760ec57c0c1da2f, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:59.367056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 956/1879] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:59 2022] PUT /identity/v3/projects/b7465678d590418b9624c483c16a19d0/users/8c61e3ec1d0741f2a6e99068c0acd465/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:59.368017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4419e1-f7d4-403f-be3a-dd6714fa70a7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:59.378777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.379517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.380283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.386917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 924/1880] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:38:59 2022] PUT /identity/v3/projects/c017aab66e144027af0cbf82e4e3ba19/users/5de8013869e74ec2a760ec57c0c1da2f/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:38:59.399723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04e91-00af-4b0e-af14-42d752d76761 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.400037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04e91-00af-4b0e-af14-42d752d76761 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.400384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab04e91-00af-4b0e-af14-42d752d76761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.432477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:59.436568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7ab04e91-00af-4b0e-af14-42d752d76761 None None] MFA Rules not processed for user `5de8013869e74ec2a760ec57c0c1da2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:59.438452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7ab04e91-00af-4b0e-af14-42d752d76761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:59.441928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] MFA Rules not processed for user `8c61e3ec1d0741f2a6e99068c0acd465`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:38:59.444237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:59.578769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 957/1881] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:38:59.594939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:59.597361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:59.606866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 925/1882] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:38:59.682190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a0f61-445d-4b8e-aaa6-ff793f003c0f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.692956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.693567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.695313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.695313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.720791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:38:59.723181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:38:59.737790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 958/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:38:59.793252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04e91-00af-4b0e-af14-42d752d76761 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:59.825008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab04e91-00af-4b0e-af14-42d752d76761 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:38:59.836999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51f3c-512c-4c75-ade1-b9ab5fc87258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:38:59.837862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51f3c-512c-4c75-ade1-b9ab5fc87258 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:38:59.838368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51f3c-512c-4c75-ade1-b9ab5fc87258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:38:59.838847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51f3c-512c-4c75-ade1-b9ab5fc87258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:38:59.848944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-08c51f3c-512c-4c75-ade1-b9ab5fc87258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:38:59.921262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:38:59.937856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:38:59.940285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:00.003908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51f3c-512c-4c75-ade1-b9ab5fc87258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.007320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51f3c-512c-4c75-ade1-b9ab5fc87258 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.025405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 926/1884] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:38:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:00.075044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a7974-638a-489f-8955-0ed1812e126c service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:00.080495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:00.081210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.081662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.082060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] PATH_INFO: `/v3/projects/228c35e80a3f4cc28e788545402b309a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.083264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=228c35e80a3f4cc28e788545402b309a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.093076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.167614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:00.171455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228c35e80a3f4cc28e788545402b309a', 'request_id': 'req-c00cdf79-1b55-43d0-b92d-d6b4876327ca'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.182355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228c35e80a3f4cc28e788545402b309a', 'request_id': 'req-c00cdf79-1b55-43d0-b92d-d6b4876327ca'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.195923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228c35e80a3f4cc28e788545402b309a', 'request_id': 'req-c00cdf79-1b55-43d0-b92d-d6b4876327ca'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.219491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] The token cache is being invalidate because project 228c35e80a3f4cc28e788545402b309a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:00.220160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.220781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c00cdf79-1b55-43d0-b92d-d6b4876327ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.223130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 959/1885] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:38:59 2022] DELETE /identity/v3/projects/228c35e80a3f4cc28e788545402b309a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:00.228092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947137d6-789a-4221-b3f2-8ae4a11d13d7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.228629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947137d6-789a-4221-b3f2-8ae4a11d13d7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.228629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947137d6-789a-4221-b3f2-8ae4a11d13d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.252787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-947137d6-789a-4221-b3f2-8ae4a11d13d7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:00.254532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-947137d6-789a-4221-b3f2-8ae4a11d13d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:00.360862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 927/1886] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:00.369259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80c1f-668f-4c1c-8a92-1d03b5642640 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.369795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80c1f-668f-4c1c-8a92-1d03b5642640 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.370916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80c1f-668f-4c1c-8a92-1d03b5642640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.404595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b6e80c1f-668f-4c1c-8a92-1d03b5642640 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:00.406215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b6e80c1f-668f-4c1c-8a92-1d03b5642640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:00.421120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 960/1887] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:00.428473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947137d6-789a-4221-b3f2-8ae4a11d13d7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:00.443977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947137d6-789a-4221-b3f2-8ae4a11d13d7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:00.461732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:00.462711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.463216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.463716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.464631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:00.465131 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.467935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.499086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 928/1888] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:00.503728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80c1f-668f-4c1c-8a92-1d03b5642640 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:00.523089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80c1f-668f-4c1c-8a92-1d03b5642640 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:00.544841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968446e6-7620-40ca-bbb4-56e64f2f4a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:00.547618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968446e6-7620-40ca-bbb4-56e64f2f4a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.548143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968446e6-7620-40ca-bbb4-56e64f2f4a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.548829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968446e6-7620-40ca-bbb4-56e64f2f4a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.550185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968446e6-7620-40ca-bbb4-56e64f2f4a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.553636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968446e6-7620-40ca-bbb4-56e64f2f4a5c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.604932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 961/1889] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:00 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:00.606139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:00.621192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ff53-362b-415e-a0cb-2151d97a52fc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:00.634512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413f9f0-05a6-4fa5-81f0-293bd5a8d5f4 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.634834 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413f9f0-05a6-4fa5-81f0-293bd5a8d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.635431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413f9f0-05a6-4fa5-81f0-293bd5a8d5f4 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.637180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 962/1890] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:39:00.661570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e7d3a-3d42-4e61-8747-e513b8b31228 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.661861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e7d3a-3d42-4e61-8747-e513b8b31228 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.662145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e7d3a-3d42-4e61-8747-e513b8b31228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.690558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a22e7d3a-3d42-4e61-8747-e513b8b31228 None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:00.691927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a22e7d3a-3d42-4e61-8747-e513b8b31228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:00.739487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:00.740137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.740417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.740698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.741668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.743657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.778092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 929/1891] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:00 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:00.778881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:00.782983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:00.795317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390da4-877d-46fa-9773-11d77c635aa1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:00.800235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:00.801103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.801570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.801975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] PATH_INFO: `/v3/users/bceb20c1b94c400fa06d4bf78ed4942a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.803250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bceb20c1b94c400fa06d4bf78ed4942a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.805854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.807642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 963/1892] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:00.809890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e7d3a-3d42-4e61-8747-e513b8b31228 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:00.830942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e7d3a-3d42-4e61-8747-e513b8b31228 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:00.836705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:00.838369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.838660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.839000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.840583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.844231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.857988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 964/1893] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:00.859174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:00.861133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:00.885049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f30f4-0f2e-470c-aa80-b5d4ca2d703b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:00.886819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:00.895182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:00.895885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.896233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.896516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.902940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bceb20c1b94c400fa06d4bf78ed4942a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.904778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bceb20c1b94c400fa06d4bf78ed4942a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.909208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bceb20c1b94c400fa06d4bf78ed4942a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.910694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:00.913395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:00.918360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bceb20c1b94c400fa06d4bf78ed4942a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.933083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-350f661f-2f09-4cd9-bf88-367a960c9376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bceb20c1b94c400fa06d4bf78ed4942a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:00.940574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 965/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:00.941423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:00.956172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 930/1895] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:00 2022] DELETE /identity/v3/users/bceb20c1b94c400fa06d4bf78ed4942a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:00.961514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:00.963533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:00.963941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:00.969467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044723f8-74dc-492c-8331-63b12437c66d service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.008703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:01.011813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:01.116814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 931/1896] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:01.117419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.118080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.118356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.118634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.119716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.127299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.130062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.132101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:01.148896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 966/1897] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:01.152748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.158670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:01.220270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f04d7-872c-4037-aaf6-913d8818f8e4 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.248151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d4fa5-e174-452d-92a6-000f92f096d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.250040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d4fa5-e174-452d-92a6-000f92f096d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.251284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d4fa5-e174-452d-92a6-000f92f096d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.251758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d4fa5-e174-452d-92a6-000f92f096d7 admin admin] PATH_INFO: `/v3/projects/cb9558e9aba8436db4ae4cdfc1da24b9/users/66f3b6fd41ca4d33a17c6bec3aed2164/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.257644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:01.312776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d4fa5-e174-452d-92a6-000f92f096d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9558e9aba8436db4ae4cdfc1da24b9, user_id=66f3b6fd41ca4d33a17c6bec3aed2164, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.317253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d4fa5-e174-452d-92a6-000f92f096d7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.345011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 967/1898] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:01 2022] PUT /identity/v3/projects/cb9558e9aba8436db4ae4cdfc1da24b9/users/66f3b6fd41ca4d33a17c6bec3aed2164/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:01.349438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e25657-2eeb-409f-aa59-84621c4836f3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.356669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318229-01ef-4afa-ac2d-e398ad78a88d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.356836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318229-01ef-4afa-ac2d-e398ad78a88d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.357062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318229-01ef-4afa-ac2d-e398ad78a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.432990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-db318229-01ef-4afa-ac2d-e398ad78a88d None None] MFA Rules not processed for user `66f3b6fd41ca4d33a17c6bec3aed2164`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:01.434896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-db318229-01ef-4afa-ac2d-e398ad78a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:01.442007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.443001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.443517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.443965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.479921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:01.521256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 968/1899] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:01.525604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db318229-01ef-4afa-ac2d-e398ad78a88d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.535529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.537727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.539015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db318229-01ef-4afa-ac2d-e398ad78a88d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.544235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.546342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.546755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.547271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.548050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.550231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 932/1900] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:01.550363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.592572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 969/1901] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:01 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:01.596070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.608364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88789475-3824-4301-ad6e-464886b4fba6 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.651395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.654843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:01.688875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.691471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.691471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.691471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.692619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.695530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.716042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01c30-0f80-46a2-a71b-de488b3bf7d0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.721315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a5a24-23c5-48e0-88f8-1bd4fb9a6b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.722041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a5a24-23c5-48e0-88f8-1bd4fb9a6b38 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.722327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a5a24-23c5-48e0-88f8-1bd4fb9a6b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.722640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a5a24-23c5-48e0-88f8-1bd4fb9a6b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.725073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f05a5a24-23c5-48e0-88f8-1bd4fb9a6b38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:01.731208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 933/1902] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:01 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:01.733277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.745468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84178f56-ff84-4862-ac51-38b9c1f50be2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.752690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.753829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.753969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.754196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.755542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.757658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.770462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 934/1903] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:01.774863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.789721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aff34-5831-4bbd-aec3-7ef6508f28bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.797879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.798556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.798974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.799625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.800429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.802985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.803482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a5a24-23c5-48e0-88f8-1bd4fb9a6b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.805117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a5a24-23c5-48e0-88f8-1bd4fb9a6b38 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.812101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:01.817739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 935/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:01.822138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:01.823372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 970/1905] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:01.834932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4bbfe-aa0e-4fc3-b917-a6edcf86780d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:01.840437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:01.841205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.841548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.842470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] PATH_INFO: `/v3/projects/94e20d6dd8c547f298237b523ce1ec8a/users/0a9c3676e26b4a80b255c7633ddfc188/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.862476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e20d6dd8c547f298237b523ce1ec8a, user_id=0a9c3676e26b4a80b255c7633ddfc188, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:01.879544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:01.910400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 936/1906] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:01 2022] PUT /identity/v3/projects/94e20d6dd8c547f298237b523ce1ec8a/users/0a9c3676e26b4a80b255c7633ddfc188/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:01.929262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f53e-0cd4-486e-86a2-f5e82e4f9f1b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:01.929623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f53e-0cd4-486e-86a2-f5e82e4f9f1b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:01.929978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4f53e-0cd4-486e-86a2-f5e82e4f9f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:01.962610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-43d4f53e-0cd4-486e-86a2-f5e82e4f9f1b None None] MFA Rules not processed for user `0a9c3676e26b4a80b255c7633ddfc188`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:01.963903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-43d4f53e-0cd4-486e-86a2-f5e82e4f9f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:02.006256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.008063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:02.057357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 971/1907] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:02.062451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f53e-0cd4-486e-86a2-f5e82e4f9f1b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.106775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0548d23-634c-44dc-a0a3-3db0896c4147 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.113760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.114541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.114905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.115252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] PATH_INFO: `/v3/projects/5feb36ed22174a598e148ec3e56d9d7e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.117489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5feb36ed22174a598e148ec3e56d9d7e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.119456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.131782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:02.162705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4f53e-0cd4-486e-86a2-f5e82e4f9f1b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.169864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.171036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.171323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.171619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.172361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.174393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.183154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5feb36ed22174a598e148ec3e56d9d7e', 'request_id': 'req-78f4739d-bb41-4d65-b6ba-524c88f49620'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.191133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5feb36ed22174a598e148ec3e56d9d7e', 'request_id': 'req-78f4739d-bb41-4d65-b6ba-524c88f49620'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.200302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5feb36ed22174a598e148ec3e56d9d7e', 'request_id': 'req-78f4739d-bb41-4d65-b6ba-524c88f49620'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.214949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 972/1908] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:02 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:02.215143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] The token cache is being invalidate because project 5feb36ed22174a598e148ec3e56d9d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:02.215143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.215143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.216277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.218565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:02.218785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 937/1909] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:02 2022] DELETE /identity/v3/projects/5feb36ed22174a598e148ec3e56d9d7e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:02.219754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.221160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:02.297132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4739d-bb41-4d65-b6ba-524c88f49620 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.302771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.303367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391435-35ae-41e2-b789-bc5b7e7f2650 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.303625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.304058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.304398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] PATH_INFO: `/v3/users/8c61e3ec1d0741f2a6e99068c0acd465` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.305639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c61e3ec1d0741f2a6e99068c0acd465)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.307678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.308074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.308686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.308969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.309247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.311629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.312201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.354109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 973/1910] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:02 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:02.356317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.369694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:02.377772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a32f1-75a1-449f-ad11-ee4ec6058b29 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.387327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.388231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.389091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.389418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.390080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.392149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.413891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c61e3ec1d0741f2a6e99068c0acd465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.414358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 974/1911] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:02.415153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c61e3ec1d0741f2a6e99068c0acd465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.415302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.416090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c61e3ec1d0741f2a6e99068c0acd465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.418019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:02.427212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c61e3ec1d0741f2a6e99068c0acd465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.443455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112e33-6135-49e4-bc07-b8c035daed54 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.452486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.456024 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.456324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.456768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] PATH_INFO: `/v3/projects/e5c5efe85cc848f193a1eef3844400d2/users/d620fa0cad724b359fe5c49f3cf3d15d/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.472097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c61e3ec1d0741f2a6e99068c0acd465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:02.500783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 938/1912] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:02 2022] DELETE /identity/v3/users/8c61e3ec1d0741f2a6e99068c0acd465 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:02.530139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c5efe85cc848f193a1eef3844400d2, user_id=d620fa0cad724b359fe5c49f3cf3d15d, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.546813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.596346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 975/1913] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:02 2022] PUT /identity/v3/projects/e5c5efe85cc848f193a1eef3844400d2/users/d620fa0cad724b359fe5c49f3cf3d15d/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:02.596449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.624723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:02.744654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4016-06a8-44e6-8f2b-41b7e20e4e07 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.887673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7d2b3-8edd-45a6-bba3-22587ce9b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.888306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d2b3-8edd-45a6-bba3-22587ce9b8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.888653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d2b3-8edd-45a6-bba3-22587ce9b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.889490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7d2b3-8edd-45a6-bba3-22587ce9b8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.890147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7d2b3-8edd-45a6-bba3-22587ce9b8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.892537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7d2b3-8edd-45a6-bba3-22587ce9b8ca admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.911634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 939/1914] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:02.913325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:02.926306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d6727-b9c6-4d13-842d-9116f3cb4c1f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:02.931698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:02.932437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.932831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.933326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] PATH_INFO: `/v3/projects/e5c5efe85cc848f193a1eef3844400d2/users/d620fa0cad724b359fe5c49f3cf3d15d/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:02.936835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c5efe85cc848f193a1eef3844400d2, user_id=d620fa0cad724b359fe5c49f3cf3d15d, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:02.940326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:02.967608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 976/1915] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:02 2022] PUT /identity/v3/projects/e5c5efe85cc848f193a1eef3844400d2/users/d620fa0cad724b359fe5c49f3cf3d15d/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:02.969867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:02.970304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:02.971123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.026821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] MFA Rules not processed for user `d620fa0cad724b359fe5c49f3cf3d15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:03.028509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:03.160124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 940/1916] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 05 10:39:03.179237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:03.181096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:03.285345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:03.287396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:03.293942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af43ad4-54f8-4686-87a3-192c8a58fab8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:03.302819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:03.303917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.304202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.304591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.319748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:03.321633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:03.338409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 977/1917] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:03.386982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:03.414217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:03.415643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:03.426704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dbe13-2b0f-4e73-9949-151c7c5a7a2a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:03.431658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:03.431792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0594f-71a8-41a3-bd0f-bffc7863b278 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:03.432307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.432591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.432865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] PATH_INFO: `/v3/projects/b7465678d590418b9624c483c16a19d0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.434042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7465678d590418b9624c483c16a19d0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:03.435374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0599e0-5686-4cd6-9781-40d4a0d9cb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:03.436042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0599e0-5686-4cd6-9781-40d4a0d9cb9c service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.436367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0599e0-5686-4cd6-9781-40d4a0d9cb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.436639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0599e0-5686-4cd6-9781-40d4a0d9cb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.436821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:03.438876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4a0599e0-5686-4cd6-9781-40d4a0d9cb9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:03.502456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7465678d590418b9624c483c16a19d0', 'request_id': 'req-cea3a6da-93da-4e50-b327-4dffefcab623'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:03.512049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7465678d590418b9624c483c16a19d0', 'request_id': 'req-cea3a6da-93da-4e50-b327-4dffefcab623'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:03.520937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0599e0-5686-4cd6-9781-40d4a0d9cb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:03.522982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0599e0-5686-4cd6-9781-40d4a0d9cb9c service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:03.523441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7465678d590418b9624c483c16a19d0', 'request_id': 'req-cea3a6da-93da-4e50-b327-4dffefcab623'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:03.535289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 978/1918] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:03.542213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] The token cache is being invalidate because project b7465678d590418b9624c483c16a19d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:03.542749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:03.543735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cea3a6da-93da-4e50-b327-4dffefcab623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:03.546960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 941/1919] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:03 2022] DELETE /identity/v3/projects/b7465678d590418b9624c483c16a19d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:03.552513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24795ec1-a3e2-40a2-a584-2be4bf70d9cd None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.552805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24795ec1-a3e2-40a2-a584-2be4bf70d9cd None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.553091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24795ec1-a3e2-40a2-a584-2be4bf70d9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.579145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-24795ec1-a3e2-40a2-a584-2be4bf70d9cd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:03.580288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-24795ec1-a3e2-40a2-a584-2be4bf70d9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:03.662790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:03.699053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 979/1920] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:03.718974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ea08-4929-4914-88ef-4be8580131a5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.719678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ea08-4929-4914-88ef-4be8580131a5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.720956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ea08-4929-4914-88ef-4be8580131a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.747441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dc83ea08-4929-4914-88ef-4be8580131a5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:03.750021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dc83ea08-4929-4914-88ef-4be8580131a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:03.764218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 942/1921] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:03.769031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24795ec1-a3e2-40a2-a584-2be4bf70d9cd None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:03.781291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24795ec1-a3e2-40a2-a584-2be4bf70d9cd None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:03.785997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:03.787223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.787646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.787815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.788679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:03.789087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:03.790721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:03.806331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 980/1922] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:03.808539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83ea08-4929-4914-88ef-4be8580131a5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:03.817787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83ea08-4929-4914-88ef-4be8580131a5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:03.822298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:03.822931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.823227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.823478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.824171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:03.826609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:03.858249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 943/1923] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:03 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:03.859741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:03.875844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112e429-c1fe-4604-9c0f-19a5dc6587d0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:03.968597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:03.969582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:03.970058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:03.970562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:03.971659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:03.975301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.008914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 981/1924] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:03 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:04.012824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.031432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779dbb3-a575-491c-8b55-5680ac6bfbb7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:04.038493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:04.039444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.039885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.040885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.041669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:04.045454 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.074257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 944/1925] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:04.079105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.104172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669fdc7-629c-43de-89c6-e63add077284 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:04.112859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7458e-9099-482f-98af-4ceb0ccf8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:04.115496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7458e-9099-482f-98af-4ceb0ccf8657 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.116105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7458e-9099-482f-98af-4ceb0ccf8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.116391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7458e-9099-482f-98af-4ceb0ccf8657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.117107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7458e-9099-482f-98af-4ceb0ccf8657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:04.121942 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7458e-9099-482f-98af-4ceb0ccf8657 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.170524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 982/1926] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:04.175252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.194828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f709b36-d5c8-4d68-ab70-bdd6100e28b6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:04.224042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:04.228334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.228468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.229716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] PATH_INFO: `/v3/projects/46d564fd5e5f4b98bb142c3d62b30668/users/5f861fed9225470ca9438d748182b0a5/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.292085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d564fd5e5f4b98bb142c3d62b30668, user_id=5f861fed9225470ca9438d748182b0a5, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:04.297488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.332018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 945/1927] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:04 2022] PUT /identity/v3/projects/46d564fd5e5f4b98bb142c3d62b30668/users/5f861fed9225470ca9438d748182b0a5/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:04.344957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030cd0-26f7-4890-aed0-e5f02f80254c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.346733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030cd0-26f7-4890-aed0-e5f02f80254c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.347071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030cd0-26f7-4890-aed0-e5f02f80254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.457084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-1a030cd0-26f7-4890-aed0-e5f02f80254c None None] MFA Rules not processed for user `5f861fed9225470ca9438d748182b0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:04.458642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1a030cd0-26f7-4890-aed0-e5f02f80254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:04.566388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 983/1928] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:04.567700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.639065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e7ff-5473-4e77-ada9-811484f3d1dd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:04.644100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:04.644710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.644995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.645400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.646047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:04.648028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.671038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:04.692617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 946/1929] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:04 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:04.693120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030cd0-26f7-4890-aed0-e5f02f80254c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.705672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030cd0-26f7-4890-aed0-e5f02f80254c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:04.761535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:04.775567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:04.776188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.776454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.776789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.777477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:04.780486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.810180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 984/1930] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:04 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:04.815064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.828657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6ce3f-8c5e-46bc-8377-3430a52be12c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:04.833786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:04.834580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.834950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.835400 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.836236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:04.838055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.854972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 947/1931] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:04.855995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.876068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebdbc7-8c47-4563-9999-f63fdfa11964 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:04.896835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:04.897361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:04.897647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:04.897930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] PATH_INFO: `/v3/projects/7f2d503e6a34463782493312b8e2c157/users/f5d495a3e80d4814b0a895fd6fb72e57/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:04.920807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2d503e6a34463782493312b8e2c157, user_id=f5d495a3e80d4814b0a895fd6fb72e57, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:04.923528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:04.943262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 985/1932] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:04 2022] PUT /identity/v3/projects/7f2d503e6a34463782493312b8e2c157/users/f5d495a3e80d4814b0a895fd6fb72e57/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:04.947272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:04.962146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a1176-006a-4231-92ef-ca13f7d48e6c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:05.089767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb863ded-78de-420c-9e82-0878f0e5e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:05.090495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863ded-78de-420c-9e82-0878f0e5e810 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:05.090848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863ded-78de-420c-9e82-0878f0e5e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:05.091243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863ded-78de-420c-9e82-0878f0e5e810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:05.092069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb863ded-78de-420c-9e82-0878f0e5e810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:05.094144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb863ded-78de-420c-9e82-0878f0e5e810 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:05.105578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 948/1933] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:05.109743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:05.125377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0562d-603d-4c00-b991-f7fdf256b00d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:05.130697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:05.131366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:05.131677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:05.131955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] PATH_INFO: `/v3/projects/7f2d503e6a34463782493312b8e2c157/users/f5d495a3e80d4814b0a895fd6fb72e57/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:05.133860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2d503e6a34463782493312b8e2c157, user_id=f5d495a3e80d4814b0a895fd6fb72e57, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:05.136868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:05.150078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 986/1934] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:05 2022] PUT /identity/v3/projects/7f2d503e6a34463782493312b8e2c157/users/f5d495a3e80d4814b0a895fd6fb72e57/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:05.161431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:05.161723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:05.162194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:05.197321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] MFA Rules not processed for user `f5d495a3e80d4814b0a895fd6fb72e57`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:05.198553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:05.277087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 949/1935] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:05.288439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:05.290494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:05.361820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c4a7d-d062-4e56-be03-8f904006b508 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:05.366141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d055e36-0c5e-4cf0-8523-767f57f951bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:05.366844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d055e36-0c5e-4cf0-8523-767f57f951bb service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:05.367177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d055e36-0c5e-4cf0-8523-767f57f951bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:05.367507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d055e36-0c5e-4cf0-8523-767f57f951bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:05.430906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d055e36-0c5e-4cf0-8523-767f57f951bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:05.432753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d055e36-0c5e-4cf0-8523-767f57f951bb service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:05.443352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 987/1936] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:06.260702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:06.262902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:06.379699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48281-64b6-4166-adf6-26a90d3bdba3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:06.387058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:06.387732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:06.388014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:06.388443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] PATH_INFO: `/v3/users/f6335bfc18954bd38928aab68e0bfe97` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:06.390451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6335bfc18954bd38928aab68e0bfe97)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:06.392475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:06.399328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:06.448211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6335bfc18954bd38928aab68e0bfe97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.448979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6335bfc18954bd38928aab68e0bfe97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.449965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6335bfc18954bd38928aab68e0bfe97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.458429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6335bfc18954bd38928aab68e0bfe97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.472048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6335bfc18954bd38928aab68e0bfe97'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.489315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 950/1937] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:06 2022] DELETE /identity/v3/users/f6335bfc18954bd38928aab68e0bfe97 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:06.494244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:06.494705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:06.494808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:06.527255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:06.528553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:06.601064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:06.614971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 988/1938] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:06.619239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:06.620707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:06.627039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:06.628682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:06.634730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f6091-56a3-4a9b-bf6b-70c80c94eee8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:06.639637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:06.640362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:06.640651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:06.640941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] PATH_INFO: `/v3/users/3bc9d54584cb428db9c14cb273b267f9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:06.642180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc9d54584cb428db9c14cb273b267f9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:06.648173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:06.708221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335afb8-a149-49fa-91ef-e10cb79af26b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:06.712113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e50b5-fc00-47b6-8de5-3d9bf3a9678a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:06.713110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e50b5-fc00-47b6-8de5-3d9bf3a9678a service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:06.713588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e50b5-fc00-47b6-8de5-3d9bf3a9678a service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:06.713878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e50b5-fc00-47b6-8de5-3d9bf3a9678a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:06.718918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc9d54584cb428db9c14cb273b267f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.719647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc9d54584cb428db9c14cb273b267f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.720291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc9d54584cb428db9c14cb273b267f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.726818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e50b5-fc00-47b6-8de5-3d9bf3a9678a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:06.729441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e50b5-fc00-47b6-8de5-3d9bf3a9678a service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:06.730030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc9d54584cb428db9c14cb273b267f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.745324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc9d54584cb428db9c14cb273b267f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:06.751812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 989/1939] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:06.765274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 951/1940] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:06 2022] DELETE /identity/v3/users/3bc9d54584cb428db9c14cb273b267f9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:06.770120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:06.770411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:06.770706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:06.793486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:06.795323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:06.892790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 990/1941] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:06.902554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:06.905384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:07.010497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516624e-cc9a-4631-b203-575cfb2c4147 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:07.016133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:07.016871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:07.017145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:07.017607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:07.029081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:07.031725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:07.038219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:07.057399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 952/1942] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:07.193031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:07.194228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:07.199487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:07.201235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:07.221328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eafe-b4a5-4827-b543-7cedb62036f4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:07.226535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705e0bb-702c-45a9-a04c-062ee1478341 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:07.234260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:07.235349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:07.235908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:07.236432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] PATH_INFO: `/v3/users/66f3b6fd41ca4d33a17c6bec3aed2164` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:07.237946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f3b6fd41ca4d33a17c6bec3aed2164)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:07.240622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:07.240965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:07.241752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:07.242146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:07.242931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] PATH_INFO: `/v3/projects/a470b500efbb4184b23e0f3a1be1bbc6` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:07.247015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a470b500efbb4184b23e0f3a1be1bbc6)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:07.256624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:07.392288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a470b500efbb4184b23e0f3a1be1bbc6', 'request_id': 'req-07673767-77d4-4bb8-8486-96e04ae70983'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.422123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a470b500efbb4184b23e0f3a1be1bbc6', 'request_id': 'req-07673767-77d4-4bb8-8486-96e04ae70983'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.439295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f3b6fd41ca4d33a17c6bec3aed2164'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.444319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f3b6fd41ca4d33a17c6bec3aed2164'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.447052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f3b6fd41ca4d33a17c6bec3aed2164'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.448325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a470b500efbb4184b23e0f3a1be1bbc6', 'request_id': 'req-07673767-77d4-4bb8-8486-96e04ae70983'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.464352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f3b6fd41ca4d33a17c6bec3aed2164'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.472290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] The token cache is being invalidate because project a470b500efbb4184b23e0f3a1be1bbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:07.472693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.473771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.475908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 991/1943] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:07 2022] DELETE /identity/v3/projects/a470b500efbb4184b23e0f3a1be1bbc6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:07.479854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:07.487759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:07.502262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a4f0aa01-6139-4828-a212-ab70dfbaef6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f3b6fd41ca4d33a17c6bec3aed2164'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.535928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 953/1944] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:07 2022] DELETE /identity/v3/users/66f3b6fd41ca4d33a17c6bec3aed2164 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:07.542863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:07.543771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:07.544241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:07.579165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:07.582802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:07.591201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:07.742893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07673767-77d4-4bb8-8486-96e04ae70983 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:07.827102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 954/1945] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:07.828121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:07.831686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:07.865389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8ac8-e428-44c4-b177-c0d252d15176 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:07.875326 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:07.876154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:07.876646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:07.876929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] PATH_INFO: `/v3/projects/0fa9548987a6466ebdd4d9ea1e38eb06` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:07.878079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa9548987a6466ebdd4d9ea1e38eb06)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:07.880340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:07.883211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:07.884080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:07.884484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:07.884866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] PATH_INFO: `/v3/users/5de8013869e74ec2a760ec57c0c1da2f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:07.886199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de8013869e74ec2a760ec57c0c1da2f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:07.888334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:07.970268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de8013869e74ec2a760ec57c0c1da2f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.971114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de8013869e74ec2a760ec57c0c1da2f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.972161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa9548987a6466ebdd4d9ea1e38eb06', 'request_id': 'req-2cad5954-6f00-4c1d-9823-715a0b41c9f2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.980561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa9548987a6466ebdd4d9ea1e38eb06', 'request_id': 'req-2cad5954-6f00-4c1d-9823-715a0b41c9f2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:07.995206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa9548987a6466ebdd4d9ea1e38eb06', 'request_id': 'req-2cad5954-6f00-4c1d-9823-715a0b41c9f2'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.005680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:08.011335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de8013869e74ec2a760ec57c0c1da2f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.023820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de8013869e74ec2a760ec57c0c1da2f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.024541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de8013869e74ec2a760ec57c0c1da2f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.024737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] The token cache is being invalidate because project 0fa9548987a6466ebdd4d9ea1e38eb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:08.025160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.026205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.027935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 955/1946] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:07 2022] DELETE /identity/v3/projects/0fa9548987a6466ebdd4d9ea1e38eb06 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:08.028904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:08.033140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:08.070978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 992/1947] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:07 2022] DELETE /identity/v3/users/5de8013869e74ec2a760ec57c0c1da2f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:08.072572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:08.082346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:08.156484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5954-6f00-4c1d-9823-715a0b41c9f2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:08.185458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:08.210482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf096a-bae6-4b46-a22e-26c9de7c6ec9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:08.221129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:08.221886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:08.222774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:08.223453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] PATH_INFO: `/v3/users/90e15f92c289459facacd51f43572314` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:08.227851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e15f92c289459facacd51f43572314)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:08.231071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:08.349890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e15f92c289459facacd51f43572314'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.350358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:08.350989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e15f92c289459facacd51f43572314'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.351452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:08.351916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:08.352356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:08.356554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:08.374083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:08.376074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:08.384393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e15f92c289459facacd51f43572314'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.393376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 956/1948] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:08.394249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:08.395736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:08.405675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e15f92c289459facacd51f43572314'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.406722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e15f92c289459facacd51f43572314'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:08.444476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 993/1949] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:08 2022] DELETE /identity/v3/users/90e15f92c289459facacd51f43572314 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:08.515971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df8cfb-c486-4e03-90a3-c18e77daff8a service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:08.594403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accbaf5-b8ad-4ba0-9432-2eaa0044cc0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:08.595170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accbaf5-b8ad-4ba0-9432-2eaa0044cc0a service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:08.595492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accbaf5-b8ad-4ba0-9432-2eaa0044cc0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:08.595820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accbaf5-b8ad-4ba0-9432-2eaa0044cc0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:08.598440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9accbaf5-b8ad-4ba0-9432-2eaa0044cc0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:08.633984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:08.701381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accbaf5-b8ad-4ba0-9432-2eaa0044cc0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:08.703631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accbaf5-b8ad-4ba0-9432-2eaa0044cc0a service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:08.718096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 957/1950] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:09.048007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:09.049617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:09.241937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2b045-64d0-41f7-b3f4-18e80c9afe0c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:09.257282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:09.264998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:09.265406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:09.265696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] PATH_INFO: `/v3/projects/c017aab66e144027af0cbf82e4e3ba19` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:09.270646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c017aab66e144027af0cbf82e4e3ba19)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:09.273101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:09.447684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c017aab66e144027af0cbf82e4e3ba19', 'request_id': 'req-bb45207c-ef8b-46fb-8471-1314aea95931'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.459903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c017aab66e144027af0cbf82e4e3ba19', 'request_id': 'req-bb45207c-ef8b-46fb-8471-1314aea95931'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.470871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c017aab66e144027af0cbf82e4e3ba19', 'request_id': 'req-bb45207c-ef8b-46fb-8471-1314aea95931'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.486151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] The token cache is being invalidate because project c017aab66e144027af0cbf82e4e3ba19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:09.486718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.487698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bb45207c-ef8b-46fb-8471-1314aea95931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.491644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 994/1951] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:09 2022] DELETE /identity/v3/projects/c017aab66e144027af0cbf82e4e3ba19 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:09.493981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:09.494574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:09.495082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:09.534788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:09.548986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:09.671451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 958/1952] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:09.680581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495c1a-852e-4ce2-9bbc-b478baf3c592 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:09.680952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495c1a-852e-4ce2-9bbc-b478baf3c592 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:09.681147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495c1a-852e-4ce2-9bbc-b478baf3c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:09.692580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:09.709728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b6495c1a-852e-4ce2-9bbc-b478baf3c592 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:09.712034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b6495c1a-852e-4ce2-9bbc-b478baf3c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:09.728595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 995/1953] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:09.729432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:09.729560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495c1a-852e-4ce2-9bbc-b478baf3c592 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:09.731756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:09.741617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495c1a-852e-4ce2-9bbc-b478baf3c592 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:09.747381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:09.748437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:09.748814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:09.749191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:09.749884 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:09.750470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:09.752472 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:09.755482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d40473-100a-4516-a2e8-5719c273b7e0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:09.765096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:09.766453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:09.766956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:09.767487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] PATH_INFO: `/v3/users/99eb6445288b429ab66d0d3a53304e3a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:09.769278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99eb6445288b429ab66d0d3a53304e3a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:09.771475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 996/1954] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:09.771981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:09.776255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:09.778150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:09.793489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0c334-0c5c-418c-80c9-bfeddec3c069 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:09.798977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:09.799794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:09.800177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:09.800729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] PATH_INFO: `/v3/projects/cb9558e9aba8436db4ae4cdfc1da24b9` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:09.802582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb9558e9aba8436db4ae4cdfc1da24b9)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:09.804974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:09.864498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99eb6445288b429ab66d0d3a53304e3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.865895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99eb6445288b429ab66d0d3a53304e3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.866595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99eb6445288b429ab66d0d3a53304e3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.877392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99eb6445288b429ab66d0d3a53304e3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.898047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99eb6445288b429ab66d0d3a53304e3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.922958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 959/1955] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:09 2022] DELETE /identity/v3/users/99eb6445288b429ab66d0d3a53304e3a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:09.922958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:09.924629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:09.931411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9558e9aba8436db4ae4cdfc1da24b9', 'request_id': 'req-4b012849-6972-4e20-8b45-2d88f571e652'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.948399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9558e9aba8436db4ae4cdfc1da24b9', 'request_id': 'req-4b012849-6972-4e20-8b45-2d88f571e652'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.981898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9558e9aba8436db4ae4cdfc1da24b9', 'request_id': 'req-4b012849-6972-4e20-8b45-2d88f571e652'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:09.995561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:10.007373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] The token cache is being invalidate because project cb9558e9aba8436db4ae4cdfc1da24b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:10.007739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.010648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.012776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 997/1956] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:09 2022] DELETE /identity/v3/projects/cb9558e9aba8436db4ae4cdfc1da24b9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:10.014125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.021476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.035207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54b322-b6f2-4dfc-adc9-7057fbe20b9c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.041780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ce10e-32c6-4dad-870d-848e0ea68e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.042632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce10e-32c6-4dad-870d-848e0ea68e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.043263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce10e-32c6-4dad-870d-848e0ea68e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.043828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce10e-32c6-4dad-870d-848e0ea68e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.044739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ce10e-32c6-4dad-870d-848e0ea68e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.047422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ce10e-32c6-4dad-870d-848e0ea68e48 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.081796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 960/1957] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:09 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:10.083483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.083949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.087896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.125349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b012849-6972-4e20-8b45-2d88f571e652 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.128097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:10.129576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.197598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.198682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.199134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.199570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] PATH_INFO: `/v3/projects/485a36656eeb4aeb8bddc32e6acf937e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.201812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485a36656eeb4aeb8bddc32e6acf937e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.204092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.221692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 961/1958] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:10.222799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.227882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.253989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b3284-2ce4-4129-a987-398d34e364b9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.256343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:10.268140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.268927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.269232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.272435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] PATH_INFO: `/v3/users/0a9c3676e26b4a80b255c7633ddfc188` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.276657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9c3676e26b4a80b255c7633ddfc188)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.278627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.311050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485a36656eeb4aeb8bddc32e6acf937e', 'request_id': 'req-872ff20a-9343-4f39-828f-776cfa609962'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.324994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485a36656eeb4aeb8bddc32e6acf937e', 'request_id': 'req-872ff20a-9343-4f39-828f-776cfa609962'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.335175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485a36656eeb4aeb8bddc32e6acf937e', 'request_id': 'req-872ff20a-9343-4f39-828f-776cfa609962'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.357140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] The token cache is being invalidate because project 485a36656eeb4aeb8bddc32e6acf937e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:10.357578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.358528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.360776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 998/1959] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:10 2022] DELETE /identity/v3/projects/485a36656eeb4aeb8bddc32e6acf937e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:10.361607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.363206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.364329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9c3676e26b4a80b255c7633ddfc188'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.365218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9c3676e26b4a80b255c7633ddfc188'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.365862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9c3676e26b4a80b255c7633ddfc188'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.375129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9c3676e26b4a80b255c7633ddfc188'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.390447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9c3676e26b4a80b255c7633ddfc188'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:10.410343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 962/1960] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:10 2022] DELETE /identity/v3/users/0a9c3676e26b4a80b255c7633ddfc188 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:10.414959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.416850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.484535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:10.486204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff20a-9343-4f39-828f-776cfa609962 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.533785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbebc-90a9-4137-90e9-f4085ed04e07 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.549836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.553100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.554840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.555373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.560372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.656232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f523c9a-9393-47bf-aaf3-1315a7d0c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.656864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523c9a-9393-47bf-aaf3-1315a7d0c0fd admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.657148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523c9a-9393-47bf-aaf3-1315a7d0c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.657423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523c9a-9393-47bf-aaf3-1315a7d0c0fd admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.658072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f523c9a-9393-47bf-aaf3-1315a7d0c0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.660055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f523c9a-9393-47bf-aaf3-1315a7d0c0fd admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.685698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.689244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.700429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 999/1961] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:10 2022] POST /identity/v3/users => generated 292 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:10.708371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689011d1-0d19-4047-af2e-9618daa4a65b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.708673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689011d1-0d19-4047-af2e-9618daa4a65b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.708951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689011d1-0d19-4047-af2e-9618daa4a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.718811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 963/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:10.719735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.723943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.758902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-689011d1-0d19-4047-af2e-9618daa4a65b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:10.760749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-689011d1-0d19-4047-af2e-9618daa4a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.771110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1000/1963] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:10.773882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3b7f7-5317-41b2-8305-d856fd30d404 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.786704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.787207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff5ea-ee08-4ca2-ac7c-57eab2950e81 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.787565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff5ea-ee08-4ca2-ac7c-57eab2950e81 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.787937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff5ea-ee08-4ca2-ac7c-57eab2950e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.788151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.788617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.789073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.790551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.792455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.804995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 964/1964] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:10.808967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.816066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b4dff5ea-ee08-4ca2-ac7c-57eab2950e81 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:10.818544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b4dff5ea-ee08-4ca2-ac7c-57eab2950e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:10.830947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36614d6e-14bb-4c81-b519-3e1aa3f08945 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.839268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1001/1965] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:10.843993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dff5ea-ee08-4ca2-ac7c-57eab2950e81 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.846327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.846980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.847280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.847615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.848218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.850010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.861870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dff5ea-ee08-4ca2-ac7c-57eab2950e81 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.878996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 965/1966] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:10.883291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.894477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.897897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.898055 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618369f4-6943-43ba-b43a-e3fbf4a16416 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.898140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.898268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.901815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:10.902290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.912053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e6ff1-53c2-4666-9543-d19c619c722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.912783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6ff1-53c2-4666-9543-d19c619c722d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.913069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6ff1-53c2-4666-9543-d19c619c722d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.913351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6ff1-53c2-4666-9543-d19c619c722d admin admin] PATH_INFO: `/v3/projects/19ba68cd98914ee5b8e7f4767e8a82b0/users/a86cda83ee444fdd9ae0fc0ef3451683/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.914539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.938317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1002/1967] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:39:10.944449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:10.953499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e6ff1-53c2-4666-9543-d19c619c722d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ba68cd98914ee5b8e7f4767e8a82b0, user_id=a86cda83ee444fdd9ae0fc0ef3451683, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.956626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e6ff1-53c2-4666-9543-d19c619c722d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:10.971890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1f502-197d-4bde-b0d3-217d360975c1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:10.983218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 966/1968] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:10 2022] PUT /identity/v3/projects/19ba68cd98914ee5b8e7f4767e8a82b0/users/a86cda83ee444fdd9ae0fc0ef3451683/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:10.987013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:10.987681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:10.987967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:10.988240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:10.989018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:10.990823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.000858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.001537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.002045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.005650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:11.037021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1003/1969] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:10 2022] POST /identity/v3/projects => generated 407 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:11.040154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.058809 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] MFA Rules not processed for user `a86cda83ee444fdd9ae0fc0ef3451683`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:11.062892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:11.159938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c062d-dbd7-4bdf-90ad-8056a07e7f28 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.169162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.171098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.171630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.172073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.172866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.175529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.193784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 967/1970] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:11.195087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.201892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:11.229721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1004/1971] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:11 2022] POST /identity/v3/users => generated 304 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:11.236022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.243015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2100c-c197-417e-8a1d-d052820fcda5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.250847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a99a-2091-495e-96e5-1a9989979c0d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.255434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.257869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.258021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.258190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.258433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] PATH_INFO: `/v3/projects/94e20d6dd8c547f298237b523ce1ec8a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.259099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.259462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.259845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.260625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.262777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.262899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e20d6dd8c547f298237b523ce1ec8a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.265558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.311461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1005/1972] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:11 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:11.311461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.316440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:11.385327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e20d6dd8c547f298237b523ce1ec8a', 'request_id': 'req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.405266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e20d6dd8c547f298237b523ce1ec8a', 'request_id': 'req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.413200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1daf-1419-42b6-a4b9-b859e7e54143 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.415403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e20d6dd8c547f298237b523ce1ec8a', 'request_id': 'req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.428856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] The token cache is being invalidate because project 94e20d6dd8c547f298237b523ce1ec8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:11.429167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.429941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.431544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 968/1973] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:11 2022] DELETE /identity/v3/projects/94e20d6dd8c547f298237b523ce1ec8a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:11.434479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.434479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:11.522171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.523168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.523721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.524368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.525980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.528220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.549302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1006/1974] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:11.551097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.554252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:11.562714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9aa06-6e26-4bb2-bcbc-ca0834cb7c77 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.566971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:11.577939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.578587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.579129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.579472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.580099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a82d-767e-4202-9960-b2860f6fe3e6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.580236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.585180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.586897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.587629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.587951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.588233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] PATH_INFO: `/v3/users/d620fa0cad724b359fe5c49f3cf3d15d` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.606139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d620fa0cad724b359fe5c49f3cf3d15d)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.608796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.633431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 969/1975] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:11 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:11.633431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.637253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:11.651478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324e175-e764-4e8a-a8ee-728b29085829 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.658495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.659125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.659667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.659788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.661796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.662586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.681556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 970/1976] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:11.682516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.697514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462eb17-3181-4a3a-8f3c-4f0ffc56a4a3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.703811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.704571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.704858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.705136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.705957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.707893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.712234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd620fa0cad724b359fe5c49f3cf3d15d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.713721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd620fa0cad724b359fe5c49f3cf3d15d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.724561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 971/1977] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:11.724561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.725711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:11.741812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a39c0-3eb6-49e4-b0ad-55ef788df746 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.751707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd620fa0cad724b359fe5c49f3cf3d15d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.752871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8f09d-d93e-4334-a204-2bbd14940bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:11.753897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8f09d-d93e-4334-a204-2bbd14940bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.754617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8f09d-d93e-4334-a204-2bbd14940bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.755039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8f09d-d93e-4334-a204-2bbd14940bd6 admin admin] PATH_INFO: `/v3/projects/dc10ffb97a97495cb584635948ecde31/users/3926c38a63b54f57a4d5548e9f8fc814/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.762049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd620fa0cad724b359fe5c49f3cf3d15d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.763388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd620fa0cad724b359fe5c49f3cf3d15d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:11.792026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1007/1978] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:11 2022] DELETE /identity/v3/users/d620fa0cad724b359fe5c49f3cf3d15d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:11.793295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:11.797361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:11.799932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8f09d-d93e-4334-a204-2bbd14940bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc10ffb97a97495cb584635948ecde31, user_id=3926c38a63b54f57a4d5548e9f8fc814, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:11.808130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8f09d-d93e-4334-a204-2bbd14940bd6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:11.875941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 972/1979] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:11 2022] PUT /identity/v3/projects/dc10ffb97a97495cb584635948ecde31/users/3926c38a63b54f57a4d5548e9f8fc814/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:11.881640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe320e4-d3cf-432e-85db-c380557db9e5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:11.881931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe320e4-d3cf-432e-85db-c380557db9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:11.882211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe320e4-d3cf-432e-85db-c380557db9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:11.910108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67590-df9e-4145-8014-8391bf1a811f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:11.956906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ffe320e4-d3cf-432e-85db-c380557db9e5 None None] MFA Rules not processed for user `3926c38a63b54f57a4d5548e9f8fc814`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:11.958288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ffe320e4-d3cf-432e-85db-c380557db9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:12.028019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:12.077730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.078545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.078893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.081353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] PATH_INFO: `/v3/projects/d124154bc90343fea333193136e564a7/users/2b3dc4d420e840bab6746927daba9b33/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.105165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 973/1980] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:11 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:12.106509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe320e4-d3cf-432e-85db-c380557db9e5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:12.145042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d124154bc90343fea333193136e564a7, user_id=2b3dc4d420e840bab6746927daba9b33, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.149766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.154086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe320e4-d3cf-432e-85db-c380557db9e5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:12.171735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.172793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.173236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.173669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.174469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.176701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.191349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1008/1981] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:11 2022] PUT /identity/v3/projects/d124154bc90343fea333193136e564a7/users/2b3dc4d420e840bab6746927daba9b33/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:12.192391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:12.197276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:12.211463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:12.244435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 974/1982] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:12 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:12.244435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:12.384825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1e877-d18a-422f-9c46-712f21f2c94b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:12.387078 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f905-ddde-439c-a4d6-75f54e32904e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:12.391387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.392071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.392495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.392779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.394402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.396464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.400686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.401445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.401778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.401991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] PATH_INFO: `/v3/projects/e2d56479ba444d35ac991ecc5a7894fa` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.405545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d56479ba444d35ac991ecc5a7894fa)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.407664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.410081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 975/1983] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:12.410954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:12.437970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb067-6dd1-4233-8fc7-cb2fe6105ee1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:12.456622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.459676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.459921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.460203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.460863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.464974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.511636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 976/1984] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:12 2022] POST /identity/v3/users => generated 311 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:12.518239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:12.531913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d56479ba444d35ac991ecc5a7894fa', 'request_id': 'req-ef2f9df2-cfae-47bf-8a1e-937e34949437'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.538095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d56479ba444d35ac991ecc5a7894fa', 'request_id': 'req-ef2f9df2-cfae-47bf-8a1e-937e34949437'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.543361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8060e-5168-439a-8653-a09139864734 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:12.545795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d56479ba444d35ac991ecc5a7894fa', 'request_id': 'req-ef2f9df2-cfae-47bf-8a1e-937e34949437'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.563947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] The token cache is being invalidate because project e2d56479ba444d35ac991ecc5a7894fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:12.564439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.567156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.570632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1009/1985] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:12 2022] DELETE /identity/v3/projects/e2d56479ba444d35ac991ecc5a7894fa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:12.572379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:12.577359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:12.665728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.667256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.667791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.668272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] PATH_INFO: `/v3/projects/d124154bc90343fea333193136e564a7/users/2b3dc4d420e840bab6746927daba9b33/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.675425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d124154bc90343fea333193136e564a7, user_id=2b3dc4d420e840bab6746927daba9b33, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.683951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.705733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 977/1986] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:12 2022] PUT /identity/v3/projects/d124154bc90343fea333193136e564a7/users/2b3dc4d420e840bab6746927daba9b33/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:12.708406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:12.717161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:12.745597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f9df2-cfae-47bf-8a1e-937e34949437 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:12.799791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:12.841256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:12.853228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aefe2-39b5-4c62-9f97-cc97c05d1e10 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:12.864234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.865816 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.866661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.867464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] PATH_INFO: `/v3/users/bb319b1409ac4b83b901476590598f73` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.869312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb319b1409ac4b83b901476590598f73)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.870681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dd9d2-2017-4aec-97e5-662aea0a82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:12.870993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd9d2-2017-4aec-97e5-662aea0a82b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.871382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd9d2-2017-4aec-97e5-662aea0a82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.871773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dd9d2-2017-4aec-97e5-662aea0a82b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.872491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dd9d2-2017-4aec-97e5-662aea0a82b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:12.873181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.874887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9dd9d2-2017-4aec-97e5-662aea0a82b9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:12.893793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1010/1987] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:12.895290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:12.895424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:12.895633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:12.949132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] MFA Rules not processed for user `2b3dc4d420e840bab6746927daba9b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:12.950614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:12.964735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb319b1409ac4b83b901476590598f73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.965511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb319b1409ac4b83b901476590598f73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.966433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb319b1409ac4b83b901476590598f73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:12.976677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb319b1409ac4b83b901476590598f73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.018546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb319b1409ac4b83b901476590598f73'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.058560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 978/1988] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:12 2022] DELETE /identity/v3/users/bb319b1409ac4b83b901476590598f73 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:13.059714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:13.069731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.094162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1011/1989] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:13.106219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:13.107898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.236175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04cdc5-e081-4689-8af4-8534c108afd3 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:13.257246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bd928-3f3f-4900-bb34-c874ace0c321 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:13.273098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:13.275043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.276792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.278066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] PATH_INFO: `/v3/projects/19d685e96d7d44d1bb65d10455a9f63b/users/a807a24054bc4c1cb60af912f04ab246/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.319135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d685e96d7d44d1bb65d10455a9f63b, user_id=a807a24054bc4c1cb60af912f04ab246, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:13.328981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:13.354761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 979/1990] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:13 2022] PUT /identity/v3/projects/19d685e96d7d44d1bb65d10455a9f63b/users/a807a24054bc4c1cb60af912f04ab246/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:13.355865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:13.358052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.361882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:13.362512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.362861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.363401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.406797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:13.422194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:13.473579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059b6e8-a2a0-431c-8a57-7b1d149f56d5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:13.479366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:13.480063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.480346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.480738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] PATH_INFO: `/v3/projects/e5c5efe85cc848f193a1eef3844400d2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.482811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c5efe85cc848f193a1eef3844400d2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:13.484985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:13.496530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:13.500477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:13.535492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1012/1991] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:13.536827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:13.576414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c5efe85cc848f193a1eef3844400d2', 'request_id': 'req-35620a51-a57f-4b71-9f0c-d589579019f7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.577943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd487-5efe-4e1c-9c06-5d96c9bbd530 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:13.590243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c5efe85cc848f193a1eef3844400d2', 'request_id': 'req-35620a51-a57f-4b71-9f0c-d589579019f7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.594470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c5efe85cc848f193a1eef3844400d2', 'request_id': 'req-35620a51-a57f-4b71-9f0c-d589579019f7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.634716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] The token cache is being invalidate because project e5c5efe85cc848f193a1eef3844400d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:13.636852 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.639663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.642096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 980/1992] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:13 2022] DELETE /identity/v3/projects/e5c5efe85cc848f193a1eef3844400d2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:13.643195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:13.653904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.714997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533bfaf-1434-43e7-80b8-fed32bd7f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:13.715958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533bfaf-1434-43e7-80b8-fed32bd7f67a admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.716184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533bfaf-1434-43e7-80b8-fed32bd7f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.717245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533bfaf-1434-43e7-80b8-fed32bd7f67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.717827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533bfaf-1434-43e7-80b8-fed32bd7f67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:13.720912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533bfaf-1434-43e7-80b8-fed32bd7f67a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:13.739040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1013/1993] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:13.739040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.739040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.739040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.751010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620a51-a57f-4b71-9f0c-d589579019f7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:13.756982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:13.757725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.759384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.759707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] PATH_INFO: `/v3/projects/c1019659082e4a3d97eeb53fa42398a1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.760875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1019659082e4a3d97eeb53fa42398a1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:13.762789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:13.766680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:13.768035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.779336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1014/1994] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:13.784955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:13.787231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.834625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1019659082e4a3d97eeb53fa42398a1', 'request_id': 'req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.843174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1019659082e4a3d97eeb53fa42398a1', 'request_id': 'req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.853268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1019659082e4a3d97eeb53fa42398a1', 'request_id': 'req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.854498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5a3ad-c65c-4166-ab25-fb9ad3f9d5bf None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:13.858085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:13.867517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] The token cache is being invalidate because project c1019659082e4a3d97eeb53fa42398a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:13.867865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.869021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:13.870976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 981/1995] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:13 2022] DELETE /identity/v3/projects/c1019659082e4a3d97eeb53fa42398a1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:13.871727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:13.873708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.914269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c71e26-82b0-4b69-a248-4a76b6096e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:13.914889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c71e26-82b0-4b69-a248-4a76b6096e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.915250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c71e26-82b0-4b69-a248-4a76b6096e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.915439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c71e26-82b0-4b69-a248-4a76b6096e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.917432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-36c71e26-82b0-4b69-a248-4a76b6096e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:13.946278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026bfaa-f0b9-4475-aa2f-e3e547a89e0c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:13.952162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584755fe-de07-49a9-90f6-b09533db09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:13.952405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:13.952804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584755fe-de07-49a9-90f6-b09533db09d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.953087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584755fe-de07-49a9-90f6-b09533db09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.953364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584755fe-de07-49a9-90f6-b09533db09d6 admin admin] PATH_INFO: `/v3/projects/19d685e96d7d44d1bb65d10455a9f63b/users/a807a24054bc4c1cb60af912f04ab246/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.955339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584755fe-de07-49a9-90f6-b09533db09d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d685e96d7d44d1bb65d10455a9f63b, user_id=a807a24054bc4c1cb60af912f04ab246, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:13.958723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584755fe-de07-49a9-90f6-b09533db09d6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:13.969186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 982/1996] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:13 2022] PUT /identity/v3/projects/19d685e96d7d44d1bb65d10455a9f63b/users/a807a24054bc4c1cb60af912f04ab246/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:13.970581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0d27-1623-4d8b-bc56-8f962810dc1c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:13.971172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0d27-1623-4d8b-bc56-8f962810dc1c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:13.971301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0d27-1623-4d8b-bc56-8f962810dc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:13.987063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c71e26-82b0-4b69-a248-4a76b6096e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:13.988736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c71e26-82b0-4b69-a248-4a76b6096e5e service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:13.993284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-853a0d27-1623-4d8b-bc56-8f962810dc1c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:13.994584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-853a0d27-1623-4d8b-bc56-8f962810dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.000503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1015/1997] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:14.001894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052316-8afd-4ec4-8f71-21eab9e9b561 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.002301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052316-8afd-4ec4-8f71-21eab9e9b561 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.002594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052316-8afd-4ec4-8f71-21eab9e9b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.036331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-81052316-8afd-4ec4-8f71-21eab9e9b561 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:14.038597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-81052316-8afd-4ec4-8f71-21eab9e9b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.075722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 983/1998] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:14.077232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffde13-b501-4717-ab2a-7d49c18204a1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.077526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffde13-b501-4717-ab2a-7d49c18204a1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.078141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffde13-b501-4717-ab2a-7d49c18204a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.110028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9bffde13-b501-4717-ab2a-7d49c18204a1 None None] MFA Rules not processed for user `a807a24054bc4c1cb60af912f04ab246`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:14.111343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9bffde13-b501-4717-ab2a-7d49c18204a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.114999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1016/1999] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:14.115934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052316-8afd-4ec4-8f71-21eab9e9b561 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.126560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052316-8afd-4ec4-8f71-21eab9e9b561 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.132003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20147ee3-7ac2-4d4f-84ec-bad9d1b6df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.132621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147ee3-7ac2-4d4f-84ec-bad9d1b6df38 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.132906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147ee3-7ac2-4d4f-84ec-bad9d1b6df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.133184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147ee3-7ac2-4d4f-84ec-bad9d1b6df38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.133955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20147ee3-7ac2-4d4f-84ec-bad9d1b6df38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:14.134140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20147ee3-7ac2-4d4f-84ec-bad9d1b6df38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.136264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20147ee3-7ac2-4d4f-84ec-bad9d1b6df38 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.152773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1017/2000] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:14.152773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1368-08b4-4735-8e3b-630079fa1297 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.152773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1368-08b4-4735-8e3b-630079fa1297 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.152773 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1368-08b4-4735-8e3b-630079fa1297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.174981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b25b1368-08b4-4735-8e3b-630079fa1297 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:14.176346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b25b1368-08b4-4735-8e3b-630079fa1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.185092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1018/2001] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:14.185991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1368-08b4-4735-8e3b-630079fa1297 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.197734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1368-08b4-4735-8e3b-630079fa1297 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.204249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.205076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.205469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.205787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.206427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.208569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.220969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 984/2002] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:14.231695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffde13-b501-4717-ab2a-7d49c18204a1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.248250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffde13-b501-4717-ab2a-7d49c18204a1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.259669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1019/2003] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:14.259669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.260840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.261779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.262083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.262867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.267883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.269216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:14.269714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.275710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.288065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:14.292360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 985/2004] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:14.293135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.327193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae67cea-ac1a-425e-b540-12631cb0f568 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.382149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c745-6d83-47f4-9b16-9d1a5f2c17f0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.390331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.391063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.391346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.391493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.391677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.392007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.392296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.392433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.392558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.394442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.429344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 986/2005] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:14.430416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.444778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd743-fab9-4cc4-a676-a41fab72102c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.451360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.452426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:14.453014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.453386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.453670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.454555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.457536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.480090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.481574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.492619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 987/2006] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:14.492619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.492882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1020/2007] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:14.493987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.505329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb59b4-c6c2-426d-ae9a-04e2d7a572ab service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.561491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e680-0835-4d53-a83c-28663006f45b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.567012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.567679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.567981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.568413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.568964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.570859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.570972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.571631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.571926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.572393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.573044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.574980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.586681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 988/2008] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:14.587853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.600285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c27867-2f7c-48e9-9303-7dc938221409 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.606099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1021/2009] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:14.606233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.606233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.606233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.606525 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.607022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.607986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.608718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.618801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06355b-272a-405c-846d-5c733fee3fd0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.623692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 989/2010] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:14.625271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.626496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.626496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.626695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.626772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.627108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.628774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.639352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f879b6e-950d-41b6-a406-0b200bb40cb8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.641271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1022/2011] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:14.645650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6bd3-a042-4ab8-9577-34cdd6539146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.646325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6bd3-a042-4ab8-9577-34cdd6539146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.646479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.646614 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6bd3-a042-4ab8-9577-34cdd6539146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.647015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6bd3-a042-4ab8-9577-34cdd6539146 admin admin] PATH_INFO: `/v3/projects/10372445c3c34afcbbd0eea1b9972f3f/users/f674a058cb1b45578b891c4cf88fed0e/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.657236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e019efd-10e6-47ee-b7b3-10bc9e3d344b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.662236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.662843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.662959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6bd3-a042-4ab8-9577-34cdd6539146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10372445c3c34afcbbd0eea1b9972f3f, user_id=f674a058cb1b45578b891c4cf88fed0e, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.663128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.663514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.664199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.665902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6bd3-a042-4ab8-9577-34cdd6539146 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.666034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.679298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1023/2012] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:14.683050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 990/2013] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:14 2022] PUT /identity/v3/projects/10372445c3c34afcbbd0eea1b9972f3f/users/f674a058cb1b45578b891c4cf88fed0e/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:14.684006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.694903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44eace-b5a8-4e4d-a08a-7b3f5b99d0d9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.695352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32057c5-d3e8-4ef2-889a-5d9b0853f825 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.695506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44eace-b5a8-4e4d-a08a-7b3f5b99d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.695724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44eace-b5a8-4e4d-a08a-7b3f5b99d0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.725100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2d44eace-b5a8-4e4d-a08a-7b3f5b99d0d9 None None] MFA Rules not processed for user `f674a058cb1b45578b891c4cf88fed0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:14.726447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2d44eace-b5a8-4e4d-a08a-7b3f5b99d0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.744054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:14.756293 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.757049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.757335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.757604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] PATH_INFO: `/v3/projects/fcabe185052240738f2e17638a5b849b/users/ebc06857be664fa4a03be6fee681580c/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.774045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcabe185052240738f2e17638a5b849b, user_id=ebc06857be664fa4a03be6fee681580c, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.776833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.789165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1024/2014] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:14 2022] PUT /identity/v3/projects/fcabe185052240738f2e17638a5b849b/users/ebc06857be664fa4a03be6fee681580c/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:14.789972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.796099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 991/2015] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:14.804957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.805249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.805530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.834477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:14.841240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] MFA Rules not processed for user `ebc06857be664fa4a03be6fee681580c`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:14.842465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.861738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5e5fb-c8ef-40c9-af73-f46c35e2fbfb admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.865505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.866106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.866383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.866655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.868445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.909550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 992/2016] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:14.910351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.911692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:14.923513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2a5ac-ea59-47db-b4c2-4be39a6ed0b8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:14.927152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:14.927788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:14.928074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:14.928349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:14.933742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.935824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:14.945790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1025/2017] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:14.947209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:14.990134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:14.991584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.001392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 993/2018] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:15.023660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad8fd8-7605-4bc6-a831-9a799e4dc892 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:15.028948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:15.029745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.030036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.030314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.030955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:15.032902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.077349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1026/2019] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:14 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:15.078569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:15.090954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ffde-0eb7-4976-93e0-04320989b732 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:15.166061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:15.198273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:15.199957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.200266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.200552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.203078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:15.210669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.249720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 994/2020] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:15 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:15.253987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:15.282828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedac69-593c-48d1-9a73-fdfc522549ad admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:15.290877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:15.291871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.292435 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.292938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.293873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:15.296515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.311937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1027/2021] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:15.316825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:15.330318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5197-202b-4204-a86e-1def51f0b248 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:15.339663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:15.340572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.341272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.342166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] PATH_INFO: `/v3/projects/5c43ff6feb8e47f3887edb312e34872b/users/ea10f4c3edc34787b08a88569af9ad98/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.369395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c43ff6feb8e47f3887edb312e34872b, user_id=ea10f4c3edc34787b08a88569af9ad98, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:15.372140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.392649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 995/2022] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:15 2022] PUT /identity/v3/projects/5c43ff6feb8e47f3887edb312e34872b/users/ea10f4c3edc34787b08a88569af9ad98/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:15.408913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:15.421112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdb28d-b11d-4d9e-838c-3031ccd2460e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:15.545529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:15.556133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0de1e-d9f8-4279-b483-7da2dee0f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:15.556957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0de1e-d9f8-4279-b483-7da2dee0f255 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.557339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0de1e-d9f8-4279-b483-7da2dee0f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.557758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0de1e-d9f8-4279-b483-7da2dee0f255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.558420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0de1e-d9f8-4279-b483-7da2dee0f255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:15.560786 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0de1e-d9f8-4279-b483-7da2dee0f255 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.579952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1028/2023] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:15.584499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:15.597853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f0dc-573b-4549-94cc-4b200358349d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:15.613102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:15.614426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.615059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.615632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] PATH_INFO: `/v3/projects/5c43ff6feb8e47f3887edb312e34872b/users/ea10f4c3edc34787b08a88569af9ad98/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.618373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c43ff6feb8e47f3887edb312e34872b, user_id=ea10f4c3edc34787b08a88569af9ad98, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:15.622196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.636790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 996/2024] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:15 2022] PUT /identity/v3/projects/5c43ff6feb8e47f3887edb312e34872b/users/ea10f4c3edc34787b08a88569af9ad98/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:15.650556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87237-1337-41fd-8ff7-b2ee1fa31369 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.650556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87237-1337-41fd-8ff7-b2ee1fa31369 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.650556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87237-1337-41fd-8ff7-b2ee1fa31369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.691700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e2c87237-1337-41fd-8ff7-b2ee1fa31369 None None] MFA Rules not processed for user `ea10f4c3edc34787b08a88569af9ad98`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:15.691700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e2c87237-1337-41fd-8ff7-b2ee1fa31369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:15.800225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1029/2025] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:15.826369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:15.884642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb458e-3a09-472f-aca2-a7c4f80812a0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:15.888779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79a7de-669a-4d6b-a326-659c7d72afd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:15.889643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a7de-669a-4d6b-a326-659c7d72afd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:15.889920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a7de-669a-4d6b-a326-659c7d72afd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:15.890188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79a7de-669a-4d6b-a326-659c7d72afd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:15.898947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79a7de-669a-4d6b-a326-659c7d72afd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:15.900469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79a7de-669a-4d6b-a326-659c7d72afd2 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:15.910579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 997/2026] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:16.330849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87237-1337-41fd-8ff7-b2ee1fa31369 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:16.394835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87237-1337-41fd-8ff7-b2ee1fa31369 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:16.399438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:16.400101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:16.400377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:16.400646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] PATH_INFO: `/v3/users/ebc06857be664fa4a03be6fee681580c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:16.401790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc06857be664fa4a03be6fee681580c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:16.403817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:16.450337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc06857be664fa4a03be6fee681580c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:16.451768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc06857be664fa4a03be6fee681580c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:16.464042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc06857be664fa4a03be6fee681580c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:16.471968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc06857be664fa4a03be6fee681580c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:16.472589 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc06857be664fa4a03be6fee681580c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:16.481396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:16.489713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1030/2027] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:16 2022] DELETE /identity/v3/users/ebc06857be664fa4a03be6fee681580c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:16.494270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:16.494557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:16.494836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:16.528758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:16.529973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:16.603478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 998/2028] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:16.614423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:16.615895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:16.691684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba0b2a-7215-40b6-8c9b-fd011e36c817 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:16.695929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671843-3075-4bca-8f68-aceb72ac5a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:16.696709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671843-3075-4bca-8f68-aceb72ac5a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:16.697013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671843-3075-4bca-8f68-aceb72ac5a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:16.697346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671843-3075-4bca-8f68-aceb72ac5a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:16.708757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e671843-3075-4bca-8f68-aceb72ac5a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:16.710299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e671843-3075-4bca-8f68-aceb72ac5a77 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:16.721788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1031/2029] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:16.906395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:16.908607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:16.930922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e296af-6774-433d-9fcb-dd06806d0512 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:16.952758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:16.952758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:16.952758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:16.952758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] PATH_INFO: `/v3/users/a86cda83ee444fdd9ae0fc0ef3451683` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:16.954209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86cda83ee444fdd9ae0fc0ef3451683)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:16.957159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:17.026580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:17.043300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86cda83ee444fdd9ae0fc0ef3451683'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.044211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86cda83ee444fdd9ae0fc0ef3451683'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.046339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86cda83ee444fdd9ae0fc0ef3451683'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.054079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86cda83ee444fdd9ae0fc0ef3451683'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.069769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86cda83ee444fdd9ae0fc0ef3451683'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.083791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 999/2030] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:16 2022] DELETE /identity/v3/users/a86cda83ee444fdd9ae0fc0ef3451683 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:17.089369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:17.089730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:17.090088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:17.115732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:17.117237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:17.130778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:17.135179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:17.212565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1032/2031] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:17.224460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:17.225937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:17.240078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78e96-4fdf-4e6a-bfdb-8960787a0ca6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:17.246806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:17.247504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:17.247834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:17.248204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] PATH_INFO: `/v3/projects/fcabe185052240738f2e17638a5b849b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:17.249789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcabe185052240738f2e17638a5b849b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:17.251929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:17.298792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c928cf4-29be-4ae9-8571-71763ebb8ae8 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:17.302847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:17.303989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:17.304375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:17.304733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:17.316414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:17.317251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcabe185052240738f2e17638a5b849b', 'request_id': 'req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.317974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:17.324877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcabe185052240738f2e17638a5b849b', 'request_id': 'req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.331869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1033/2032] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:17.334330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcabe185052240738f2e17638a5b849b', 'request_id': 'req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.353586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] The token cache is being invalidate because project fcabe185052240738f2e17638a5b849b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:17.353929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.354627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.356729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1000/2033] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:17 2022] DELETE /identity/v3/projects/fcabe185052240738f2e17638a5b849b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:17.360660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:17.374697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7edf0-7e96-4e4a-a141-01dc8694b8ff service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:17.430766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:17.452006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:17.452885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:17.453216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:17.453864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] PATH_INFO: `/v3/users/ea10f4c3edc34787b08a88569af9ad98` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:17.454700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea10f4c3edc34787b08a88569af9ad98)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:17.457214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:17.526880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea10f4c3edc34787b08a88569af9ad98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.527668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea10f4c3edc34787b08a88569af9ad98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.542753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea10f4c3edc34787b08a88569af9ad98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.552353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea10f4c3edc34787b08a88569af9ad98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.553688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea10f4c3edc34787b08a88569af9ad98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.577378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1034/2034] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:17 2022] DELETE /identity/v3/users/ea10f4c3edc34787b08a88569af9ad98 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:17.688767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:17.692161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:17.736824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b0c6-381a-4da1-a01c-41871cbfc3ff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:17.792233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:17.818930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:17.819690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:17.820048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:17.820391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] PATH_INFO: `/v3/projects/19ba68cd98914ee5b8e7f4767e8a82b0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:17.822516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ba68cd98914ee5b8e7f4767e8a82b0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:17.824726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:17.882148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ba68cd98914ee5b8e7f4767e8a82b0', 'request_id': 'req-1b02e607-9e55-46b2-8081-98655c9e0f74'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.890900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ba68cd98914ee5b8e7f4767e8a82b0', 'request_id': 'req-1b02e607-9e55-46b2-8081-98655c9e0f74'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.902902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ba68cd98914ee5b8e7f4767e8a82b0', 'request_id': 'req-1b02e607-9e55-46b2-8081-98655c9e0f74'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.920773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] The token cache is being invalidate because project 19ba68cd98914ee5b8e7f4767e8a82b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:17.921328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.921697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:17.923511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1001/2035] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:17 2022] DELETE /identity/v3/projects/19ba68cd98914ee5b8e7f4767e8a82b0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:17.928270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:17.929998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:17.948093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f327-4840-479c-9d82-32f2e1480af6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:18.021490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:18.023259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:18.055915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:18.057181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.057469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.057752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] PATH_INFO: `/v3/users/2b3dc4d420e840bab6746927daba9b33` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.059415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3dc4d420e840bab6746927daba9b33)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:18.064634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:18.170558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3dc4d420e840bab6746927daba9b33'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.173336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3dc4d420e840bab6746927daba9b33'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.190531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3dc4d420e840bab6746927daba9b33'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.192448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:18.204221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3dc4d420e840bab6746927daba9b33'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.205003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-776a59e0-02ea-4128-8173-57f35ebf2f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3dc4d420e840bab6746927daba9b33'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.216123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e607-9e55-46b2-8081-98655c9e0f74 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:18.227291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:18.228156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1035/2036] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:17 2022] DELETE /identity/v3/users/2b3dc4d420e840bab6746927daba9b33 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:18.228552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.229110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.229433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] PATH_INFO: `/v3/projects/5c43ff6feb8e47f3887edb312e34872b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.231038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c43ff6feb8e47f3887edb312e34872b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:18.233231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:18.331509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c43ff6feb8e47f3887edb312e34872b', 'request_id': 'req-9e98150b-eea5-4bf2-8890-e11b60b1d91f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.340335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c43ff6feb8e47f3887edb312e34872b', 'request_id': 'req-9e98150b-eea5-4bf2-8890-e11b60b1d91f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.364209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c43ff6feb8e47f3887edb312e34872b', 'request_id': 'req-9e98150b-eea5-4bf2-8890-e11b60b1d91f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.399033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] The token cache is being invalidate because project 5c43ff6feb8e47f3887edb312e34872b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:18.399381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.400422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9e98150b-eea5-4bf2-8890-e11b60b1d91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:18.404718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1002/2037] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:18 2022] DELETE /identity/v3/projects/5c43ff6feb8e47f3887edb312e34872b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:18.409255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92014-6fb2-488f-8f03-a552b9de6b24 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.409725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92014-6fb2-488f-8f03-a552b9de6b24 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.410064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92014-6fb2-488f-8f03-a552b9de6b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.469777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d9c92014-6fb2-488f-8f03-a552b9de6b24 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:18.472534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d9c92014-6fb2-488f-8f03-a552b9de6b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:18.586299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1036/2038] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:18.593890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fd2e8-87fb-4117-8a09-c9bd25deaad0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.594186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fd2e8-87fb-4117-8a09-c9bd25deaad0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.594455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fd2e8-87fb-4117-8a09-c9bd25deaad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.612049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:18.645557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-308fd2e8-87fb-4117-8a09-c9bd25deaad0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:18.647433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-308fd2e8-87fb-4117-8a09-c9bd25deaad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:18.687891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1003/2039] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:18.692625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c92014-6fb2-488f-8f03-a552b9de6b24 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:18.704602 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c92014-6fb2-488f-8f03-a552b9de6b24 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:18.711400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:18.713721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.714186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.714611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.715721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:18.716220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:18.718575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:18.769424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1037/2040] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:18.774086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fd2e8-87fb-4117-8a09-c9bd25deaad0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:18.791828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fd2e8-87fb-4117-8a09-c9bd25deaad0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:18.796906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:18.797545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.797833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.798113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.798838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:18.800844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:18.821936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:18.824511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:18.843986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1004/2041] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:18 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:18.845075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:18.847852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c677e74-6485-44bd-930e-39e998fa069d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:18.940687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:18.941529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.942132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.942471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] PATH_INFO: `/v3/projects/d124154bc90343fea333193136e564a7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.944199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d124154bc90343fea333193136e564a7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:18.946733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:18.955042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e16344-fa54-4be1-98f5-ed761c6a1440 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:18.967260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:18.968163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:18.969176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:18.969620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:18.970294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:18.973477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.001566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1005/2042] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:18 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:19.005677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.017092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e19cc-d62d-4a56-a262-f899575b576e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.019231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd124154bc90343fea333193136e564a7', 'request_id': 'req-84df3f78-9c21-48a1-9899-dcbef06be414'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:19.029564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd124154bc90343fea333193136e564a7', 'request_id': 'req-84df3f78-9c21-48a1-9899-dcbef06be414'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:19.038045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd124154bc90343fea333193136e564a7', 'request_id': 'req-84df3f78-9c21-48a1-9899-dcbef06be414'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:19.054138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:19.060428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] The token cache is being invalidate because project d124154bc90343fea333193136e564a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:19.060601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:19.061320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-84df3f78-9c21-48a1-9899-dcbef06be414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:19.066882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1038/2043] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:18 2022] DELETE /identity/v3/projects/d124154bc90343fea333193136e564a7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:19.069041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175c9a-6de1-42b0-b102-dd20b41ef7d0 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.069734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175c9a-6de1-42b0-b102-dd20b41ef7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.070289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175c9a-6de1-42b0-b102-dd20b41ef7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.093079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.093821 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.094203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.094560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.095406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.097176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.102106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f2175c9a-6de1-42b0-b102-dd20b41ef7d0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:19.103848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f2175c9a-6de1-42b0-b102-dd20b41ef7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:19.109001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1006/2044] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:19.113395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.115208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1039/2045] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:19.115322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:19.131061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f0de-ccc2-406a-ae7c-09f06ec4403c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.133127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1f4f-3286-46ee-827c-17d5ce65a521 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.133412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1f4f-3286-46ee-827c-17d5ce65a521 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.133686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1f4f-3286-46ee-827c-17d5ce65a521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.136994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.138860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.138860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.138860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.139796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.141399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.155822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1007/2046] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:19.157041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-72bd1f4f-3286-46ee-827c-17d5ce65a521 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:19.157459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.158724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-72bd1f4f-3286-46ee-827c-17d5ce65a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:19.167712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641c99b-88dc-47da-bcf3-6632f1fef936 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.172551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1040/2047] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:19.173582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1f4f-3286-46ee-827c-17d5ce65a521 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.176779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b643d-5d17-413d-8506-bb40cfd2588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.177447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b643d-5d17-413d-8506-bb40cfd2588d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.177726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b643d-5d17-413d-8506-bb40cfd2588d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.178002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b643d-5d17-413d-8506-bb40cfd2588d admin admin] PATH_INFO: `/v3/projects/a2e9047a762446589902267900c8a4a6/users/ea9de4d2782f4ad6b7fb7e315a9b1687/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.184360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1f4f-3286-46ee-827c-17d5ce65a521 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.190204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.191398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.191845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.192129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.193162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:19.193162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.193342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b643d-5d17-413d-8506-bb40cfd2588d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e9047a762446589902267900c8a4a6, user_id=ea9de4d2782f4ad6b7fb7e315a9b1687, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.194713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.196077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b643d-5d17-413d-8506-bb40cfd2588d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.211895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1041/2048] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:39:19.212087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1008/2049] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:19 2022] PUT /identity/v3/projects/a2e9047a762446589902267900c8a4a6/users/ea9de4d2782f4ad6b7fb7e315a9b1687/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:19.212947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.221860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474da0-1bd1-436b-a688-930951fdbaf3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.222211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474da0-1bd1-436b-a688-930951fdbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.222464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474da0-1bd1-436b-a688-930951fdbaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.224632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291ccc7-83b9-40f2-a826-7311e010943b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.252668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-32474da0-1bd1-436b-a688-930951fdbaf3 None None] MFA Rules not processed for user `ea9de4d2782f4ad6b7fb7e315a9b1687`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:19.254248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-32474da0-1bd1-436b-a688-930951fdbaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:19.282635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:19.308897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.309515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.309794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.310098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.310740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.313209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.353793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1042/2050] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:19.357477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1009/2051] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:19.361066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.362231 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474da0-1bd1-436b-a688-930951fdbaf3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.374001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474da0-1bd1-436b-a688-930951fdbaf3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.460655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bf2c-72d3-4ed0-99ca-8f5a33e4bc9c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.467093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.468089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.468705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.469122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.469905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.472031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.488391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.489023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.489345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.489586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.490248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.494212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.502495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1043/2052] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:19.508074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.527501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908cf56-ab96-4cbe-841e-8740e3d6d98f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.535571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.536394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.536800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.538209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.539112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.541959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.555409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1044/2053] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:19.559359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.560373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1010/2054] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:19.564482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.573646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8cfc-2b41-4ab1-ac54-6e3ee9295e80 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.620121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:19.682647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9b0db-d8d9-4725-bac9-7e7426f52ebf admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.688449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.689074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.689751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.689751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.690443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.692586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.695409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.696080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.696409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.696693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.697453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.701979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.723977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1011/2055] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:19.727227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.731642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1045/2056] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:19.735244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.746473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daac514-5fd7-4266-a25b-7f3f843cf8a8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.747976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce86f1-657c-4411-9f77-d7fc05fa5ef0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.753397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118a5d-62bd-4039-a577-49b7624e6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.755113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118a5d-62bd-4039-a577-49b7624e6012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.755489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.755751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118a5d-62bd-4039-a577-49b7624e6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.756192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118a5d-62bd-4039-a577-49b7624e6012 admin admin] PATH_INFO: `/v3/projects/d012b90995204a789085168cdd0dcbb3/users/d7a5863431e44eff8b94dcdf8758a4ce/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.756819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.757198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.757747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.759350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.764237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.778127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1012/2057] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:19.782688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.783801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118a5d-62bd-4039-a577-49b7624e6012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d012b90995204a789085168cdd0dcbb3, user_id=d7a5863431e44eff8b94dcdf8758a4ce, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.790591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118a5d-62bd-4039-a577-49b7624e6012 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.798239 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4c6b-8b65-499e-9a2d-bfffcc02ea80 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.805883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:19.806553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.806863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.807103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.807876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:19.809858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:19.813077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1046/2058] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:19 2022] PUT /identity/v3/projects/d012b90995204a789085168cdd0dcbb3/users/d7a5863431e44eff8b94dcdf8758a4ce/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:19.828788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e501e-dc47-4a57-8bf8-17303c38971d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:19.837625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1013/2059] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:19.837715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e501e-dc47-4a57-8bf8-17303c38971d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:19.837715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e501e-dc47-4a57-8bf8-17303c38971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:19.839159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:19.861096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830d4be-1dc7-4e8a-8c1b-0924c8e54dd6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:19.873456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:19.909052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-066e501e-dc47-4a57-8bf8-17303c38971d None None] MFA Rules not processed for user `d7a5863431e44eff8b94dcdf8758a4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:19.912947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-066e501e-dc47-4a57-8bf8-17303c38971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:20.004155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37580508-5f23-45b9-a43e-2a48dad58ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.005181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580508-5f23-45b9-a43e-2a48dad58ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.005408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580508-5f23-45b9-a43e-2a48dad58ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.009415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580508-5f23-45b9-a43e-2a48dad58ab2 admin admin] PATH_INFO: `/v3/projects/17898eccd52440d0a05b60ed7cf76146/users/bb10000fc4ae46f0b967c7621a477e34/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.035018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580508-5f23-45b9-a43e-2a48dad58ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17898eccd52440d0a05b60ed7cf76146, user_id=bb10000fc4ae46f0b967c7621a477e34, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.038227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580508-5f23-45b9-a43e-2a48dad58ab2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.067682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1014/2060] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:19 2022] PUT /identity/v3/projects/17898eccd52440d0a05b60ed7cf76146/users/bb10000fc4ae46f0b967c7621a477e34/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:20.073823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ce84-3deb-41e9-9aed-d3667cba6306 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.074119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ce84-3deb-41e9-9aed-d3667cba6306 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.074405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807ce84-3deb-41e9-9aed-d3667cba6306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.077661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1047/2061] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:20.083332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e501e-dc47-4a57-8bf8-17303c38971d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.101453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e501e-dc47-4a57-8bf8-17303c38971d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.150060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5807ce84-3deb-41e9-9aed-d3667cba6306 None None] MFA Rules not processed for user `bb10000fc4ae46f0b967c7621a477e34`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:20.151516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5807ce84-3deb-41e9-9aed-d3667cba6306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:20.218810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.219460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.219776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.220059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.220838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.223043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.258733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1048/2062] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:20 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:20.262697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.265226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1015/2063] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:20.270206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807ce84-3deb-41e9-9aed-d3667cba6306 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.288369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807ce84-3deb-41e9-9aed-d3667cba6306 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.307441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:20.353789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b7e5-8506-4933-906e-42e3f63bbbc7 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.361323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.361494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.361906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.362008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.362191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.362306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.362489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.362620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.363104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.363206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.365076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.365179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.390147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1049/2064] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:20 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:20.394350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.400388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1016/2065] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:20 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:20.401790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.408331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23557e53-9449-4c6b-9c23-62451fdbbe41 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.417547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:20.483198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.484717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.485059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.485476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.486226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.487956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.497802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffcf3a-45f7-4c53-913c-46cf1d57316f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.499662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1050/2066] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:20.503403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.503557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.504146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.504921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.505147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.505800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.508110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.517699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d1ed-4cb8-44ae-b412-17027e2aca1f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.523009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.523712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.524008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.524620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] PATH_INFO: `/v3/projects/7b76770548004fab8cff773b3680dfa7/users/93b0c88dd62e4e5689788dd74cc77391/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.537190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1017/2067] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:20 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:20.541979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.545715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b76770548004fab8cff773b3680dfa7, user_id=93b0c88dd62e4e5689788dd74cc77391, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.548814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.556101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9843-9bad-4a0a-8517-dd123c3ca499 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.562770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.563461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.563790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.564122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.564766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.566534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.573356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1051/2068] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:20 2022] PUT /identity/v3/projects/7b76770548004fab8cff773b3680dfa7/users/93b0c88dd62e4e5689788dd74cc77391/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:20.579162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1018/2069] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:20.580172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.584309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.605275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2074b-9b11-4f93-98fe-b8c41b869be9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.697576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.698444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.698741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.699501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] PATH_INFO: `/v3/projects/b0d27a07c6aa4d619ab67bbf18a4386a/users/e250de08b8d84ed08b0d1b75ff027eb3/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.699748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551011f-da1b-4fa3-9378-f26ccae6cd0a admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.721609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.722724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.724100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.724392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.724671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d27a07c6aa4d619ab67bbf18a4386a, user_id=e250de08b8d84ed08b0d1b75ff027eb3, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.725069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.729262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.741212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.750406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1052/2070] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:20.751772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.769577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62395144-7425-4b84-b625-2d9355fa1313 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.772487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1019/2071] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:20 2022] PUT /identity/v3/projects/b0d27a07c6aa4d619ab67bbf18a4386a/users/e250de08b8d84ed08b0d1b75ff027eb3/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:20.777486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.825282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:20.904207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.904892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.905178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.905461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] PATH_INFO: `/v3/projects/7b76770548004fab8cff773b3680dfa7/users/93b0c88dd62e4e5689788dd74cc77391/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.907381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67f17-76a1-4e52-9b33-94724ef09160 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:20.907909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b76770548004fab8cff773b3680dfa7, user_id=93b0c88dd62e4e5689788dd74cc77391, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.911905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.918672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab858-f46d-4db1-a14e-ebbcc9d88001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:20.919352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab858-f46d-4db1-a14e-ebbcc9d88001 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.920778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab858-f46d-4db1-a14e-ebbcc9d88001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.921070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab858-f46d-4db1-a14e-ebbcc9d88001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.921727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab858-f46d-4db1-a14e-ebbcc9d88001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:20.924337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab858-f46d-4db1-a14e-ebbcc9d88001 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:20.937017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1053/2072] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:20 2022] PUT /identity/v3/projects/7b76770548004fab8cff773b3680dfa7/users/93b0c88dd62e4e5689788dd74cc77391/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:20.945367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1020/2073] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:20.953606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:20.955678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:20.958679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:20.959007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:20.984396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:21.041303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] MFA Rules not processed for user `93b0c88dd62e4e5689788dd74cc77391`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:21.042478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.090296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af39216-d946-41b3-9adf-25d0cbebff9e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:21.112510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44373a-e4a4-4a2d-997a-d39d7871b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:21.113558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44373a-e4a4-4a2d-997a-d39d7871b1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.114011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44373a-e4a4-4a2d-997a-d39d7871b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.114439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44373a-e4a4-4a2d-997a-d39d7871b1a7 admin admin] PATH_INFO: `/v3/projects/b0d27a07c6aa4d619ab67bbf18a4386a/users/e250de08b8d84ed08b0d1b75ff027eb3/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.118658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44373a-e4a4-4a2d-997a-d39d7871b1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d27a07c6aa4d619ab67bbf18a4386a, user_id=e250de08b8d84ed08b0d1b75ff027eb3, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:21.122099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44373a-e4a4-4a2d-997a-d39d7871b1a7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:21.150006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1054/2074] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:20 2022] PUT /identity/v3/projects/b0d27a07c6aa4d619ab67bbf18a4386a/users/e250de08b8d84ed08b0d1b75ff027eb3/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:21.166243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.167050 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.167490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.213488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] MFA Rules not processed for user `e250de08b8d84ed08b0d1b75ff027eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:21.217855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.230753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1021/2075] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:21.300371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:21.308571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.391535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1055/2076] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:21.397279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:21.399706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84291c-314f-4339-b0ee-3c770a552055 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:21.400816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.474952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:21.485931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:21.486548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.486828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.487098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.502939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c46035-7124-47fe-8ec1-8c3081b4abe3 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:21.510746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:21.511335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.511637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.511914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] PATH_INFO: `/v3/users/3926c38a63b54f57a4d5548e9f8fc814` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.513609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3926c38a63b54f57a4d5548e9f8fc814)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:21.516083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:21.562840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:21.565562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:21.567331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:21.572696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3926c38a63b54f57a4d5548e9f8fc814'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:21.573377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3926c38a63b54f57a4d5548e9f8fc814'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:21.578076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1022/2077] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:21.578885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:21.580352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.589787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3926c38a63b54f57a4d5548e9f8fc814'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:21.593759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672b40-f130-42ea-9a8c-356f5ae7d470 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:21.598694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:21.599308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3926c38a63b54f57a4d5548e9f8fc814'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:21.599548 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.599931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.600213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.600582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f0253ed6-96e7-4149-8ef8-ab8149ee058c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3926c38a63b54f57a4d5548e9f8fc814'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:21.602087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.616473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1056/2078] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:21 2022] DELETE /identity/v3/users/3926c38a63b54f57a4d5548e9f8fc814 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:21.621326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f3be-281f-48fe-a6fb-af67223c4270 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.621721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f3be-281f-48fe-a6fb-af67223c4270 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.621973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75f3be-281f-48fe-a6fb-af67223c4270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.647716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0c75f3be-281f-48fe-a6fb-af67223c4270 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:21.648943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0c75f3be-281f-48fe-a6fb-af67223c4270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.679574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:21.681063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:21.700417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1023/2079] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:21.750397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:21.752497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.762835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1057/2080] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:21.765474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928cea0-8a63-4ca7-8686-00762de4e374 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.765864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928cea0-8a63-4ca7-8686-00762de4e374 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.766200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928cea0-8a63-4ca7-8686-00762de4e374 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.769426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b51e-f222-484d-a4af-4ff79d3681cb service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:21.770999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1058/2081] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:39:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:39:21.775405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928cea0-8a63-4ca7-8686-00762de4e374 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:21.777407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2928cea0-8a63-4ca7-8686-00762de4e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.842492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:21.843273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.843630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.843911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.847245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.866026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928cea0-8a63-4ca7-8686-00762de4e374 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:21.872915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badd902-6ade-431a-8667-08d58eb27c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:21.873639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd902-6ade-431a-8667-08d58eb27c3b service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.873927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd902-6ade-431a-8667-08d58eb27c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.874211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd902-6ade-431a-8667-08d58eb27c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.889009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badd902-6ade-431a-8667-08d58eb27c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:21.891096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badd902-6ade-431a-8667-08d58eb27c3b service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:21.895415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:21.903032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1059/2082] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:21.905671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.906508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.907623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.920238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:21.921826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:21.932355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1024/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:21.933514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:21.935038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.951262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1b7d-bb19-43d3-9e97-3fdcc120f5f0 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:21.952045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:21.953308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:21.958290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:21.959259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:21.959923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:21.960412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] PATH_INFO: `/v3/users/ee3a89d96fca43148c1d955f30ca9e22` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:21.962016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3a89d96fca43148c1d955f30ca9e22)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:21.966080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:22.048392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:22.054652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3a89d96fca43148c1d955f30ca9e22'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.055935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3a89d96fca43148c1d955f30ca9e22'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.058562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3a89d96fca43148c1d955f30ca9e22'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.073386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3a89d96fca43148c1d955f30ca9e22'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.095512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1060/2084] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:22.097844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3a89d96fca43148c1d955f30ca9e22'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.128447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:22.130502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:22.144578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1025/2085] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:21 2022] DELETE /identity/v3/users/ee3a89d96fca43148c1d955f30ca9e22 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:22.155442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a646a8-b8c8-4080-a947-41fa6fdde579 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:22.297445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:22.299182 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:22.343128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:22.344001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:22.344296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:22.344557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:22.360685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:22.364397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:22.388601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1061/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:22.463987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:22.468766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:22.504030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd9e67-9f57-418c-82c5-0d420a5a1202 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:22.519402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:22.520153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:22.520439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:22.520725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] PATH_INFO: `/v3/projects/dc10ffb97a97495cb584635948ecde31` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:22.525052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc10ffb97a97495cb584635948ecde31)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:22.527150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:22.598195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36034ee1-a51f-4b20-99ed-e144a353588b service placement] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:22.602958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc10ffb97a97495cb584635948ecde31', 'request_id': 'req-ff29d226-b574-4fb3-83ae-c84fdd67b95c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.611624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc10ffb97a97495cb584635948ecde31', 'request_id': 'req-ff29d226-b574-4fb3-83ae-c84fdd67b95c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.628034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc10ffb97a97495cb584635948ecde31', 'request_id': 'req-ff29d226-b574-4fb3-83ae-c84fdd67b95c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.643959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] The token cache is being invalidate because project dc10ffb97a97495cb584635948ecde31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:22.644591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.645297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.647662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1026/2087] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:22 2022] DELETE /identity/v3/projects/dc10ffb97a97495cb584635948ecde31 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:22.651856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:22.653530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:22.653763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:22.729988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:22.730819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:22.731103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:22.731384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] PATH_INFO: `/v3/projects/c7d6b91294034080a8e17ee3de3ad22d` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:22.738917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d6b91294034080a8e17ee3de3ad22d)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:22.740921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:22.769756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:22.790539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29d226-b574-4fb3-83ae-c84fdd67b95c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:22.801571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:22.801723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:22.805238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:22.805238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] PATH_INFO: `/v3/users/a807a24054bc4c1cb60af912f04ab246` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:22.805238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a807a24054bc4c1cb60af912f04ab246)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:22.806101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:22.827774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d6b91294034080a8e17ee3de3ad22d', 'request_id': 'req-a85b69de-de87-4264-adbe-6f17b7f12fa8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.834409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d6b91294034080a8e17ee3de3ad22d', 'request_id': 'req-a85b69de-de87-4264-adbe-6f17b7f12fa8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.841758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d6b91294034080a8e17ee3de3ad22d', 'request_id': 'req-a85b69de-de87-4264-adbe-6f17b7f12fa8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.856401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] The token cache is being invalidate because project c7d6b91294034080a8e17ee3de3ad22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:22.857149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.858048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.859581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1062/2088] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:22 2022] DELETE /identity/v3/projects/c7d6b91294034080a8e17ee3de3ad22d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:22.860754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:22.864235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:22.877222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a807a24054bc4c1cb60af912f04ab246'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.878112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a807a24054bc4c1cb60af912f04ab246'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.878778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a807a24054bc4c1cb60af912f04ab246'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.886437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a807a24054bc4c1cb60af912f04ab246'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.901383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f4989b3e-b17e-4d95-a2a5-61b80afd92e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a807a24054bc4c1cb60af912f04ab246'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:22.914926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1027/2089] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:22 2022] DELETE /identity/v3/users/a807a24054bc4c1cb60af912f04ab246 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:22.916360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21583e0d-05c2-4adc-9833-7a9155232ff9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:22.916649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21583e0d-05c2-4adc-9833-7a9155232ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:22.916923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21583e0d-05c2-4adc-9833-7a9155232ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:22.938872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-21583e0d-05c2-4adc-9833-7a9155232ff9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:22.939210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b69de-de87-4264-adbe-6f17b7f12fa8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:22.940297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-21583e0d-05c2-4adc-9833-7a9155232ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.012343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.012928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1028/2090] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:23.013923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.014208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.014549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] PATH_INFO: `/v3/users/d7a5863431e44eff8b94dcdf8758a4ce` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.020550 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a5863431e44eff8b94dcdf8758a4ce)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.022027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b0aff-325a-44ce-9a05-52e3d2245d89 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.022311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b0aff-325a-44ce-9a05-52e3d2245d89 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.022611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b0aff-325a-44ce-9a05-52e3d2245d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.023072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.037260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:23.046839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2a3b0aff-325a-44ce-9a05-52e3d2245d89 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:23.048186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a3b0aff-325a-44ce-9a05-52e3d2245d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.058040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1029/2091] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:23.063042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b0aff-325a-44ce-9a05-52e3d2245d89 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.074531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b0aff-325a-44ce-9a05-52e3d2245d89 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.080946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.081489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.081769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.082048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.082705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:23.083011 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.085291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.098286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a5863431e44eff8b94dcdf8758a4ce'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.098988 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a5863431e44eff8b94dcdf8758a4ce'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.103266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1030/2092] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:39:23.108208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.110601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.118342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a5863431e44eff8b94dcdf8758a4ce'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.132617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a5863431e44eff8b94dcdf8758a4ce'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.133121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157d829-c09f-4de0-8c53-103507cb22fb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.133793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-70e5a078-655c-460c-9847-811489e115f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a5863431e44eff8b94dcdf8758a4ce'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.139012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.139650 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.139941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.140216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.140849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.142920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.149121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1063/2093] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:22 2022] DELETE /identity/v3/users/d7a5863431e44eff8b94dcdf8758a4ce => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:23.153418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.154253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.154869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.177401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:23.178615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.185772 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1031/2094] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:23.189549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.236892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:23.266018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1064/2095] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:23.267641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.269246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.282859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036c73a-76e5-45d3-a21d-1891a1a7421f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.283366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88080988-b19f-4455-8076-9b8d55e5752b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.288751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.289348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.289492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.289798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.290153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.290251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.290438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.290721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] PATH_INFO: `/v3/projects/19d685e96d7d44d1bb65d10455a9f63b` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.290885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.292877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d685e96d7d44d1bb65d10455a9f63b)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.293180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.295006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.319791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1032/2096] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:23.319791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.319791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.359621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d685e96d7d44d1bb65d10455a9f63b', 'request_id': 'req-e890c2a3-d1ac-4fbd-a52b-912cef073b94'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.370551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d685e96d7d44d1bb65d10455a9f63b', 'request_id': 'req-e890c2a3-d1ac-4fbd-a52b-912cef073b94'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.378064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d685e96d7d44d1bb65d10455a9f63b', 'request_id': 'req-e890c2a3-d1ac-4fbd-a52b-912cef073b94'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.398272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] The token cache is being invalidate because project 19d685e96d7d44d1bb65d10455a9f63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:23.398272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.399059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:23.405563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1065/2097] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:23 2022] DELETE /identity/v3/projects/19d685e96d7d44d1bb65d10455a9f63b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:23.405563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.406803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.409953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3db3-0d86-436f-a313-1a6ebdfb2c00 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.421854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:23.474165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1918c6-7664-494d-9b52-bf351c0f30cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.474786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1918c6-7664-494d-9b52-bf351c0f30cd service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.475061 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1918c6-7664-494d-9b52-bf351c0f30cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.475333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1918c6-7664-494d-9b52-bf351c0f30cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.477246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bf1918c6-7664-494d-9b52-bf351c0f30cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.487897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890c2a3-d1ac-4fbd-a52b-912cef073b94 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.490864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1918c6-7664-494d-9b52-bf351c0f30cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.492453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1918c6-7664-494d-9b52-bf351c0f30cd service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.492669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.493278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.493561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.493832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.494474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.496100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.504701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1033/2098] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:23.505889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0166ac8-9caa-4265-b6eb-43bd3fa30095 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.506378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0166ac8-9caa-4265-b6eb-43bd3fa30095 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.506665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0166ac8-9caa-4265-b6eb-43bd3fa30095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.507641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1066/2099] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:23.512653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.525697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49be1b8-fe88-4d3d-82a7-ffa4b98bb3b0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.532726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.533424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.533912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.534282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.535023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.536783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.541629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c0166ac8-9caa-4265-b6eb-43bd3fa30095 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:23.543117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c0166ac8-9caa-4265-b6eb-43bd3fa30095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.551227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1067/2100] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:23.552117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.569251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1034/2101] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:23.571031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.571317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.571622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.581113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316b4b1-017b-4897-9ae6-cee11c5500dd admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.596849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.597530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.597810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.598133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] PATH_INFO: `/v3/projects/be65a2826afc45b2a915174101c26f63/users/96e9216d8a994f03b50eb64fa6516f51/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.600989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:23.604049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.614386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1035/2102] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:23.615520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.616938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.617020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] RBAC: Authorizing `identity:create_grant(project_id=be65a2826afc45b2a915174101c26f63, user_id=96e9216d8a994f03b50eb64fa6516f51, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.619905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.635406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1068/2103] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:23 2022] PUT /identity/v3/projects/be65a2826afc45b2a915174101c26f63/users/96e9216d8a994f03b50eb64fa6516f51/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:23.640840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.704031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9734c53-a748-41ab-bd67-d069f9e466a9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.721077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4c53-9f11-4f52-8997-0b591eedadae admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.723386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:23.726301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851406-ee28-4a71-bd37-3cc918c15543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.727085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851406-ee28-4a71-bd37-3cc918c15543 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.727303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851406-ee28-4a71-bd37-3cc918c15543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.727693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851406-ee28-4a71-bd37-3cc918c15543 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.728369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851406-ee28-4a71-bd37-3cc918c15543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:23.728675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851406-ee28-4a71-bd37-3cc918c15543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.730292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851406-ee28-4a71-bd37-3cc918c15543 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.745375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1069/2104] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:23.750632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e2cd-ebae-4e55-b925-c9d202603c19 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.751070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e2cd-ebae-4e55-b925-c9d202603c19 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.751570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48e2cd-ebae-4e55-b925-c9d202603c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.762516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.764093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.764421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.764739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.766637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.772759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ff48e2cd-ebae-4e55-b925-c9d202603c19 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:23.773959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ff48e2cd-ebae-4e55-b925-c9d202603c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.782294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1070/2105] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:23.784487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e2cd-ebae-4e55-b925-c9d202603c19 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.798567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48e2cd-ebae-4e55-b925-c9d202603c19 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.806196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.806865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.807144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.807426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.808212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.811238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.835316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.836974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:23.847549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1036/2106] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:23.848499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.849887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.861732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1071/2107] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:23.862582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:23.864255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:23.915181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763675a9-06e8-49e4-9f48-1dcc6d2f9ba3 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.945947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:23.984144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44c61a-1863-4e5c-b14f-e607b85924fc admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:23.986481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.987356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.987765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.988121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.992025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:23.992817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:23.993152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:23.993420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] PATH_INFO: `/v3/projects/d012b90995204a789085168cdd0dcbb3` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:23.994673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d012b90995204a789085168cdd0dcbb3)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:23.996881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.009111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.012128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.030348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1037/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:24.031023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.042940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb18bbc-a605-4f47-8a8e-2a8a062d4278 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.054204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.055494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.057267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.057593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.058456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.061069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.093367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1038/2109] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:24 2022] POST /identity/v3/users => generated 287 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:24.094104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd012b90995204a789085168cdd0dcbb3', 'request_id': 'req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.098059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.109666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed586bc-7fe2-4616-8b12-b9b08a7cd08e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.121037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd012b90995204a789085168cdd0dcbb3', 'request_id': 'req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.126304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:24.139444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd012b90995204a789085168cdd0dcbb3', 'request_id': 'req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.163160 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] The token cache is being invalidate because project d012b90995204a789085168cdd0dcbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:24.166105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.168120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.175244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1072/2110] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:23 2022] DELETE /identity/v3/projects/d012b90995204a789085168cdd0dcbb3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:24.176301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.177715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:24.209013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.209906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.210741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.211264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.212158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.214808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.229569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1039/2111] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:24.234626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.239836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:24.265642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62258e-e3fa-4e14-b3b4-429d787b6080 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.268141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0d462-bc42-44ae-9ee5-7dbd2b012a59 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.272908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.273948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.274555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.275148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.276098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.278554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.280234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.281008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.281801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.282089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] PATH_INFO: `/v3/users/93b0c88dd62e4e5689788dd74cc77391` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.284199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b0c88dd62e4e5689788dd74cc77391)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.287959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.304327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1040/2112] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:24.309360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.329647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b3ac2-229c-4d12-80b3-a6b41817b7df admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.336948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638965fa-4da9-446e-a6c4-0ee0ac352cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.337845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638965fa-4da9-446e-a6c4-0ee0ac352cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.338861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638965fa-4da9-446e-a6c4-0ee0ac352cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.339885 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638965fa-4da9-446e-a6c4-0ee0ac352cd4 admin admin] PATH_INFO: `/v3/projects/1e132c779505494f979aa8e8769561ea/users/9bc12cf52ac847a7bfeac95ca2e2f2f3/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.367694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638965fa-4da9-446e-a6c4-0ee0ac352cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e132c779505494f979aa8e8769561ea, user_id=9bc12cf52ac847a7bfeac95ca2e2f2f3, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.371039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638965fa-4da9-446e-a6c4-0ee0ac352cd4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.374944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b0c88dd62e4e5689788dd74cc77391'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.375658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b0c88dd62e4e5689788dd74cc77391'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.391166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1041/2113] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:24 2022] PUT /identity/v3/projects/1e132c779505494f979aa8e8769561ea/users/9bc12cf52ac847a7bfeac95ca2e2f2f3/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:24.396808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.397703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.398090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.402620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b0c88dd62e4e5689788dd74cc77391'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.407663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:24.414494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b0c88dd62e4e5689788dd74cc77391'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.415205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b0c88dd62e4e5689788dd74cc77391'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:24.432896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:24.434421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:24.435683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1073/2114] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:24 2022] DELETE /identity/v3/users/93b0c88dd62e4e5689788dd74cc77391 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:24.552533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1042/2115] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:24.567440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.569958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:24.688259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ccc7-a07f-4389-9b93-9a0eddc58dfd admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.692483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.693105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.693384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.693657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.708303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.710604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.722144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1074/2116] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:24.789764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.791636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:24.865452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d96c7-2f56-4569-af0a-9df84965b50c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.869419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f787a34-cbff-47f9-9a36-137805704890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.870096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f787a34-cbff-47f9-9a36-137805704890 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.870375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f787a34-cbff-47f9-9a36-137805704890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.870784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f787a34-cbff-47f9-9a36-137805704890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.873901 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1f787a34-cbff-47f9-9a36-137805704890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:24.888512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:24.890069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:24.907473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e9615-bbd0-426a-9120-9cd03c1496f5 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:24.913846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:24.914632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:24.914918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:24.915199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] PATH_INFO: `/v3/projects/7b76770548004fab8cff773b3680dfa7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:24.932726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b76770548004fab8cff773b3680dfa7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.935701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:24.937668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:24.992467 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f787a34-cbff-47f9-9a36-137805704890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:24.996149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f787a34-cbff-47f9-9a36-137805704890 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:25.011300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1043/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:25.048490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b76770548004fab8cff773b3680dfa7', 'request_id': 'req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.060977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b76770548004fab8cff773b3680dfa7', 'request_id': 'req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.070714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b76770548004fab8cff773b3680dfa7', 'request_id': 'req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.095143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] The token cache is being invalidate because project 7b76770548004fab8cff773b3680dfa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:25.095725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.096620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdf4ebc1-e10c-4f3a-b207-dfc6275c6ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.100488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1075/2118] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:24 2022] DELETE /identity/v3/projects/7b76770548004fab8cff773b3680dfa7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:25.105929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c453e7-2b87-4d01-9de0-c6a39d34c94a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.107572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c453e7-2b87-4d01-9de0-c6a39d34c94a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.108082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c453e7-2b87-4d01-9de0-c6a39d34c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.145847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-53c453e7-2b87-4d01-9de0-c6a39d34c94a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:25.147746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-53c453e7-2b87-4d01-9de0-c6a39d34c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:25.259549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1044/2119] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:25.268510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88fcb-9882-4cd8-86ce-521b9a7de4ab None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.268510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88fcb-9882-4cd8-86ce-521b9a7de4ab None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.268510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88fcb-9882-4cd8-86ce-521b9a7de4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.292926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-21e88fcb-9882-4cd8-86ce-521b9a7de4ab None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:25.294895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-21e88fcb-9882-4cd8-86ce-521b9a7de4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:25.317720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1076/2120] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:25.323109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c453e7-2b87-4d01-9de0-c6a39d34c94a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:25.367468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c453e7-2b87-4d01-9de0-c6a39d34c94a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:25.383861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:25.384534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.384763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.387342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.388942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:25.389407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:25.391325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:25.407960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1045/2121] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:39:25.411153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88fcb-9882-4cd8-86ce-521b9a7de4ab None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:25.423959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88fcb-9882-4cd8-86ce-521b9a7de4ab None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:25.426296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:25.428352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:25.440061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:25.440745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.441031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.441311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.442676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:25.447878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:25.454350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042fcab-6ecb-42be-8ebb-c9afdc57c84b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:25.469470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:25.473331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.473627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.473916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] PATH_INFO: `/v3/users/5f861fed9225470ca9438d748182b0a5` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.479343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f861fed9225470ca9438d748182b0a5)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:25.487302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:25.513309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1077/2122] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:25 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:25.514393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:25.588427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:25.619296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1223a-da82-4bc8-9667-ceea179213d6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:25.622380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f861fed9225470ca9438d748182b0a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.623616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f861fed9225470ca9438d748182b0a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.624395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f861fed9225470ca9438d748182b0a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.639392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f861fed9225470ca9438d748182b0a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.640279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7b428-d928-4a92-8038-f088de32726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:25.642144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7b428-d928-4a92-8038-f088de32726e admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.642608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7b428-d928-4a92-8038-f088de32726e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.643816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7b428-d928-4a92-8038-f088de32726e admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.644469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7b428-d928-4a92-8038-f088de32726e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:25.649941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7b428-d928-4a92-8038-f088de32726e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:25.670652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f861fed9225470ca9438d748182b0a5'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:25.693033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1078/2123] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:25 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:25.693033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395efac-41c9-4ffc-aa23-52b8ece7d99d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.693033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395efac-41c9-4ffc-aa23-52b8ece7d99d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.693033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395efac-41c9-4ffc-aa23-52b8ece7d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.703566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1046/2124] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:25 2022] DELETE /identity/v3/users/5f861fed9225470ca9438d748182b0a5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:25.708408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:25.712362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:25.738030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c395efac-41c9-4ffc-aa23-52b8ece7d99d None None] MFA Rules not processed for user `9bc12cf52ac847a7bfeac95ca2e2f2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:25.739564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c395efac-41c9-4ffc-aa23-52b8ece7d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:25.778944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:25.850170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9f24f-4d50-4b51-8357-4be9d23284f5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:25.858348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:25.859260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.859667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.860099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.861591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:25.863662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1079/2125] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:25.867470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:25.867566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a195a7-d356-4502-b74a-24ff5d92a31c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.867566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a195a7-d356-4502-b74a-24ff5d92a31c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.867566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a195a7-d356-4502-b74a-24ff5d92a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.878038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1047/2126] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:25.879028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:25.881968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:25.919787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e4a195a7-d356-4502-b74a-24ff5d92a31c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:25.930789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e4a195a7-d356-4502-b74a-24ff5d92a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:25.932565 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9422e-c05a-430a-961d-d432d564ccdb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:25.941916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1080/2127] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:25.942966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a195a7-d356-4502-b74a-24ff5d92a31c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:25.950190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:25.953129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.953424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.955035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.957649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:25.960397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a195a7-d356-4502-b74a-24ff5d92a31c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:25.962070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:25.981130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:25.982405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:25.982855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:25.983134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:25.983809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:25.986053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:26.006922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1081/2128] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:26.007863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.010699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:26.026376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1048/2129] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:25 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:26.030700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.116158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9c2c-77c4-434a-9378-3b2bf78de9b5 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:26.144428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895cd58-df0e-42d4-bf32-dda0f247fd47 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:26.152284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:26.154277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.154887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.155925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] PATH_INFO: `/v3/projects/c91d1a999b034967bab9fdbfbd5486c2/users/801c1edec56e4532b0c8f04adab5119e/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.181682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91d1a999b034967bab9fdbfbd5486c2, user_id=801c1edec56e4532b0c8f04adab5119e, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:26.185477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:26.193240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea404-d172-427d-9cd9-0a6c896666df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:26.194161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea404-d172-427d-9cd9-0a6c896666df service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.194598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea404-d172-427d-9cd9-0a6c896666df service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.195052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea404-d172-427d-9cd9-0a6c896666df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.205109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1049/2130] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:26 2022] PUT /identity/v3/projects/c91d1a999b034967bab9fdbfbd5486c2/users/801c1edec56e4532b0c8f04adab5119e/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:26.214937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.218412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea404-d172-427d-9cd9-0a6c896666df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:26.220249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ea404-d172-427d-9cd9-0a6c896666df service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:26.234381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1082/2131] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:26.236301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.236622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.236994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.247894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:26.300048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] MFA Rules not processed for user `801c1edec56e4532b0c8f04adab5119e`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:26.303659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:26.420332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ae183-42db-46c5-9385-6f99606809b0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:26.430187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:26.430807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.433950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.434242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.435416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:26.440616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:26.464991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1083/2132] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:26.477479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.480162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:26.518285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1050/2133] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:26 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:26.520065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.538952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a67c71-a86b-4043-afaa-bc0448c25098 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:26.549020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:26.549914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.550199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.550471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.551346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:26.554370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:26.571811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1051/2134] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:26.573491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.581371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:26.593987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ce2bd-71d0-4286-aa24-6c1d97cbe8af admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:26.602045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:26.603410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.603925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.604226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] PATH_INFO: `/v3/projects/13fcd89cfdd2440fa472c81ecc57b07c/users/d6a5f8a4cf464feaa0254abc75f2a6be/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.630909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fcd89cfdd2440fa472c81ecc57b07c, user_id=d6a5f8a4cf464feaa0254abc75f2a6be, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:26.641662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:26.672114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1052/2135] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:26 2022] PUT /identity/v3/projects/13fcd89cfdd2440fa472c81ecc57b07c/users/d6a5f8a4cf464feaa0254abc75f2a6be/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:26.677820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.682320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f6f24-151d-4582-b36b-0aa8d2405091 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:26.862623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717ade6a084349a8864cf15ce0d827fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:26.863260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.863523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.863827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.874874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e035a-6619-413c-999a-eb225ea38407 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:26.892003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:26.892552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:26.892851 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:26.893125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:26.893777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:26.903054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:26.946229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1053/2136] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:26.946229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:26.948204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:26.967346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4d43e-72f7-4bdb-bc5c-e5f33ed075db admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:27.016832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:27.022111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:27.022994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:27.023445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:27.023921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] PATH_INFO: `/v3/projects/46d564fd5e5f4b98bb142c3d62b30668` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:27.025278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d564fd5e5f4b98bb142c3d62b30668)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:27.027462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:27.039992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:27.041603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:27.092521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1084/2137] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:27.093367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:27.137062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344309d5-2c6a-4a28-aa2a-be541e8ae2c9 service glance] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:27.164724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d564fd5e5f4b98bb142c3d62b30668', 'request_id': 'req-11237721-0b57-4682-acbc-1bab27a49850'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.172064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d564fd5e5f4b98bb142c3d62b30668', 'request_id': 'req-11237721-0b57-4682-acbc-1bab27a49850'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.187080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d564fd5e5f4b98bb142c3d62b30668', 'request_id': 'req-11237721-0b57-4682-acbc-1bab27a49850'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.231025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] The token cache is being invalidate because project 46d564fd5e5f4b98bb142c3d62b30668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:27.235289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.236183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.240770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1054/2138] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:26 2022] DELETE /identity/v3/projects/46d564fd5e5f4b98bb142c3d62b30668 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:27.242009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:27.244013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:27.290241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:27.294047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:27.294703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:27.295072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] PATH_INFO: `/v3/projects/13fcd89cfdd2440fa472c81ecc57b07c/users/d6a5f8a4cf464feaa0254abc75f2a6be/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:27.300235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fcd89cfdd2440fa472c81ecc57b07c, user_id=d6a5f8a4cf464feaa0254abc75f2a6be, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:27.307979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:27.327857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1085/2139] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:27 2022] PUT /identity/v3/projects/13fcd89cfdd2440fa472c81ecc57b07c/users/d6a5f8a4cf464feaa0254abc75f2a6be/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:27.334775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:27.340401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237721-0b57-4682-acbc-1bab27a49850 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:27.463103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:27.464243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:27.464243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:27.464440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] PATH_INFO: `/v3/users/f5d495a3e80d4814b0a895fd6fb72e57` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:27.465574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d495a3e80d4814b0a895fd6fb72e57)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:27.470723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:27.550397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d495a3e80d4814b0a895fd6fb72e57'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.551246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d495a3e80d4814b0a895fd6fb72e57'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.552029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d495a3e80d4814b0a895fd6fb72e57'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.580429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d495a3e80d4814b0a895fd6fb72e57'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.610328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74f42638-b312-4a45-a1cd-e9dc56bcb3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d495a3e80d4814b0a895fd6fb72e57'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:27.651159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1055/2140] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:27 2022] DELETE /identity/v3/users/f5d495a3e80d4814b0a895fd6fb72e57 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:28.228267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:28.230782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:28.256052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558436-756d-42be-a525-e844a2bad891 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:28.404567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:28.406567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:28.406907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:28.407192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] PATH_INFO: `/v3/projects/7f2d503e6a34463782493312b8e2c157` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:28.411044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2d503e6a34463782493312b8e2c157)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:28.414219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:28.512444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2d503e6a34463782493312b8e2c157', 'request_id': 'req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:28.533754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2d503e6a34463782493312b8e2c157', 'request_id': 'req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:28.561326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2d503e6a34463782493312b8e2c157', 'request_id': 'req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:28.581732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] The token cache is being invalidate because project 7f2d503e6a34463782493312b8e2c157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:28.582309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:28.583170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ebbcc715-6b4d-47d3-85c7-1f4b180ebfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:28.584915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1086/2141] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:28 2022] DELETE /identity/v3/projects/7f2d503e6a34463782493312b8e2c157 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:28.590010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db50c-596b-44be-a8c3-a3adfdccafae None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:28.590542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db50c-596b-44be-a8c3-a3adfdccafae None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:28.590542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db50c-596b-44be-a8c3-a3adfdccafae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:28.617381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a84db50c-596b-44be-a8c3-a3adfdccafae None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:28.626434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a84db50c-596b-44be-a8c3-a3adfdccafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:28.753805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd500-e583-4989-906a-2fe0a96d2d08 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:28.754122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd500-e583-4989-906a-2fe0a96d2d08 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:28.754365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd500-e583-4989-906a-2fe0a96d2d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:28.758627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1056/2142] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:28.779704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c98dd500-e583-4989-906a-2fe0a96d2d08 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:28.780756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c98dd500-e583-4989-906a-2fe0a96d2d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:28.795532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db50c-596b-44be-a8c3-a3adfdccafae None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:28.806462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1087/2143] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:28.807788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db50c-596b-44be-a8c3-a3adfdccafae None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:28.813873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:28.814525 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:28.814952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:28.815200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:28.815912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:28.816219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:28.817846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:28.832976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1057/2144] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:28.837889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dd500-e583-4989-906a-2fe0a96d2d08 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:28.846570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:28.858828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dd500-e583-4989-906a-2fe0a96d2d08 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:28.882766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:28.886620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:28.888748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:28.889159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:28.891759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:28.896580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:28.990887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1088/2145] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:28 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:28.996064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:29.012649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cee2e6-5c77-400c-a53e-0158def879c9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:29.035159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:29.194150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:29.194693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.195384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.195691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.196350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:29.199507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:29.255643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1058/2146] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:28 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:29.258026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:29.276956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880c546-4284-4f8a-a246-01a6ef339518 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:29.284749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:29.285592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.285719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.286042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.286695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:29.289239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:29.362120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1089/2147] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:29.363491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:29.383763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f85bb-4a16-48de-ae3a-a5b6011efa01 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:29.389028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb845ed-ce10-4c4a-9acb-7030bfdac239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:29.389654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb845ed-ce10-4c4a-9acb-7030bfdac239 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.389938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb845ed-ce10-4c4a-9acb-7030bfdac239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.390749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb845ed-ce10-4c4a-9acb-7030bfdac239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.390859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb845ed-ce10-4c4a-9acb-7030bfdac239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:29.392522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb845ed-ce10-4c4a-9acb-7030bfdac239 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:29.412320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1059/2148] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:29.412920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:29.429052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240994d-dfac-4f2f-9469-bc245f29488f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:29.439297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8c8c2-b0f3-4722-8427-15096f56123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:29.440970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8c8c2-b0f3-4722-8427-15096f56123b admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.441464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8c8c2-b0f3-4722-8427-15096f56123b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.442241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8c8c2-b0f3-4722-8427-15096f56123b admin admin] PATH_INFO: `/v3/projects/1132404dabe44cae9cfc2e9a02aef227/users/fe560c62ed394f44985c864ee35f6fea/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.469889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8c8c2-b0f3-4722-8427-15096f56123b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1132404dabe44cae9cfc2e9a02aef227, user_id=fe560c62ed394f44985c864ee35f6fea, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:29.474157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8c8c2-b0f3-4722-8427-15096f56123b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:29.483667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f0043-cbb1-49ae-a151-455c1d2dfc2b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.484266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f0043-cbb1-49ae-a151-455c1d2dfc2b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.484774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f0043-cbb1-49ae-a151-455c1d2dfc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.526289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1090/2149] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:29 2022] PUT /identity/v3/projects/1132404dabe44cae9cfc2e9a02aef227/users/fe560c62ed394f44985c864ee35f6fea/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:29.528419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8687ca-3a7e-4a1f-8617-342af28eb601 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.528700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8687ca-3a7e-4a1f-8617-342af28eb601 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.528979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8687ca-3a7e-4a1f-8617-342af28eb601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.569727 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ab4f0043-cbb1-49ae-a151-455c1d2dfc2b None None] MFA Rules not processed for user `d6a5f8a4cf464feaa0254abc75f2a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:29.575037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab4f0043-cbb1-49ae-a151-455c1d2dfc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:29.622424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-fd8687ca-3a7e-4a1f-8617-342af28eb601 None None] MFA Rules not processed for user `fe560c62ed394f44985c864ee35f6fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:29.624301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fd8687ca-3a7e-4a1f-8617-342af28eb601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:29.692167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1060/2150] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:29.702958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.703618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.704095 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.732455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] MFA Rules not processed for user `9bc12cf52ac847a7bfeac95ca2e2f2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:29.734692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:29.785508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1091/2151] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:29.786412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8687ca-3a7e-4a1f-8617-342af28eb601 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:29.939796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1061/2152] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:29.939796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:29.954799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:29.976408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8687ca-3a7e-4a1f-8617-342af28eb601 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:29.983790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:29.986005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:29.986547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:29.987959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:29.991663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:29.993459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e25f-cc8a-4683-a3d8-96ab027ea613 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:29.998887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:30.014354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:30.014742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.015044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.015474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] PATH_INFO: `/v3/users/ea9de4d2782f4ad6b7fb7e315a9b1687` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.017225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9de4d2782f4ad6b7fb7e315a9b1687)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:30.019029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:30.043144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1092/2153] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:29 2022] POST /identity/v3/projects => generated 367 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:30.044812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:30.049458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.062950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:30.160853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:30.170698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9de4d2782f4ad6b7fb7e315a9b1687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.174188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9de4d2782f4ad6b7fb7e315a9b1687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.174868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9de4d2782f4ad6b7fb7e315a9b1687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.189121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9de4d2782f4ad6b7fb7e315a9b1687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.214803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9de4d2782f4ad6b7fb7e315a9b1687'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.243233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1062/2154] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:29 2022] DELETE /identity/v3/users/ea9de4d2782f4ad6b7fb7e315a9b1687 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:30.244268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:30.250213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.302813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc385180-81f3-45b4-877d-62c1078e07b6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:30.398702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:30.399673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.401194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.401756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.405529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.414322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202df6-d6d7-4c2c-923a-f0e9d0d7ef18 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:30.421190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8119f5-70a0-469c-ab88-cb8c037718ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:30.422068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8119f5-70a0-469c-ab88-cb8c037718ce admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.422503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8119f5-70a0-469c-ab88-cb8c037718ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.422968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8119f5-70a0-469c-ab88-cb8c037718ce admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.428634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8119f5-70a0-469c-ab88-cb8c037718ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:30.431109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8119f5-70a0-469c-ab88-cb8c037718ce admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:30.488378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1063/2155] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:30 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:30.493561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84298ef2-4b37-4d78-8448-f10381563adf None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.494112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84298ef2-4b37-4d78-8448-f10381563adf None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.495073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84298ef2-4b37-4d78-8448-f10381563adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.529571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:30.532198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:30.546059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-84298ef2-4b37-4d78-8448-f10381563adf None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:30.547556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-84298ef2-4b37-4d78-8448-f10381563adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.551567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1093/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:30.552562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:30.557416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.579567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1064/2157] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:30.580902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84298ef2-4b37-4d78-8448-f10381563adf None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:30.605061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e1fb0-68a3-40b9-a42a-3e9d0994da3d service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:30.612963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84298ef2-4b37-4d78-8448-f10381563adf None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:30.618918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:30.619579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.619899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.620196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] PATH_INFO: `/v3/users/f674a058cb1b45578b891c4cf88fed0e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.622188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f674a058cb1b45578b891c4cf88fed0e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:30.626560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:30.627201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.627492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.627814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.628479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:30.630991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:30.633224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:30.663227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1065/2158] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:30.664168 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:30.679155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.740406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f674a058cb1b45578b891c4cf88fed0e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.741081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f674a058cb1b45578b891c4cf88fed0e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.744425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:30.771887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f674a058cb1b45578b891c4cf88fed0e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.790264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f674a058cb1b45578b891c4cf88fed0e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.795001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f674a058cb1b45578b891c4cf88fed0e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:30.813713 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8df048-bc4c-45a2-9110-51f07c08331f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:30.819695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e7c3-71fc-413f-af69-adbf7a5ff13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:30.820584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1094/2159] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:30 2022] DELETE /identity/v3/users/f674a058cb1b45578b891c4cf88fed0e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:30.820835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e7c3-71fc-413f-af69-adbf7a5ff13f service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.821453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e7c3-71fc-413f-af69-adbf7a5ff13f service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.821643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:30.822115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e7c3-71fc-413f-af69-adbf7a5ff13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.824280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9c55e7c3-71fc-413f-af69-adbf7a5ff13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.824409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.849647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e7c3-71fc-413f-af69-adbf7a5ff13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:30.851177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e7c3-71fc-413f-af69-adbf7a5ff13f service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:30.874051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1066/2160] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:30.875617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.875617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.875910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:30.910068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:30.925457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:30.927527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:30.975509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718b8d-3c4d-40c3-b056-b9c55b48ca05 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:30.994935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:30.996322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:30.996322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:30.996322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] PATH_INFO: `/v3/projects/0c0bbe1a67d24b8abbb144a14da6dfb9/users/ebe0703b232346569fad7f4ae2d24448/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:31.046955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0bbe1a67d24b8abbb144a14da6dfb9, user_id=ebe0703b232346569fad7f4ae2d24448, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:31.050100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:31.081346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1067/2161] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:31.108430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:31.111886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:31.118919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1095/2162] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:30 2022] PUT /identity/v3/projects/0c0bbe1a67d24b8abbb144a14da6dfb9/users/ebe0703b232346569fad7f4ae2d24448/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:31.128301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:31.277604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02b18-52d9-41eb-8297-173d2f3a52b0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:31.345400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21ba49-abb8-46f1-974d-37d780524b1e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:31.366574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b504fde-2397-472f-a8b2-1726bdb0a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:31.367611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b504fde-2397-472f-a8b2-1726bdb0a4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:31.367971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b504fde-2397-472f-a8b2-1726bdb0a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:31.368486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b504fde-2397-472f-a8b2-1726bdb0a4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:31.369016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b504fde-2397-472f-a8b2-1726bdb0a4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:31.373502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b504fde-2397-472f-a8b2-1726bdb0a4b3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:31.378070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:31.378701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:31.378984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:31.379287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:31.391756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:31.394574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:31.412641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1068/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:31.416497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1096/2164] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:31.422362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:31.458983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c44c4-e7f4-4b2d-aec9-f90c8c695363 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:31.464741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2346710-0d4f-4018-954b-193d2adc49f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:31.465505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346710-0d4f-4018-954b-193d2adc49f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:31.466581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346710-0d4f-4018-954b-193d2adc49f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:31.466797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2346710-0d4f-4018-954b-193d2adc49f1 admin admin] PATH_INFO: `/v3/projects/0c0bbe1a67d24b8abbb144a14da6dfb9/users/ebe0703b232346569fad7f4ae2d24448/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:31.469244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2346710-0d4f-4018-954b-193d2adc49f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0bbe1a67d24b8abbb144a14da6dfb9, user_id=ebe0703b232346569fad7f4ae2d24448, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:31.472334 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2346710-0d4f-4018-954b-193d2adc49f1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:31.497906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1069/2165] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:31 2022] PUT /identity/v3/projects/0c0bbe1a67d24b8abbb144a14da6dfb9/users/ebe0703b232346569fad7f4ae2d24448/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:31.500097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:31.500384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:31.500659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:31.547572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] MFA Rules not processed for user `ebe0703b232346569fad7f4ae2d24448`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:31.549035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:31.593948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:31.594852 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:31.595269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:31.634963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:31.673913 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] MFA Rules not processed for user `96e9216d8a994f03b50eb64fa6516f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:31.680126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:31.738271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1097/2166] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:31.751822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:31.753266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:31.781929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:31.878676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1070/2167] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:31.893864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:31.895861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:31.952458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb38b-9805-470b-8067-4aac8446035b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:31.975669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fddfe-05a4-438e-b6fe-4078b25c1402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:31.980087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fddfe-05a4-438e-b6fe-4078b25c1402 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:31.980376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fddfe-05a4-438e-b6fe-4078b25c1402 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:31.980643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fddfe-05a4-438e-b6fe-4078b25c1402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:31.996497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990c39b-5ffb-4d15-be28-2a7217819cb7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:32.005867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fddfe-05a4-438e-b6fe-4078b25c1402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:32.006147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:32.007046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.007352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fddfe-05a4-438e-b6fe-4078b25c1402 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:32.007868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.008736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] PATH_INFO: `/v3/projects/a2e9047a762446589902267900c8a4a6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:32.010186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e9047a762446589902267900c8a4a6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:32.013437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:32.033382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1098/2168] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:32.034598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.034882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.040517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:32.081643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e9047a762446589902267900c8a4a6', 'request_id': 'req-0873164a-aedf-4623-9557-7c4421497b6e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.083039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] MFA Rules not processed for user `96e9216d8a994f03b50eb64fa6516f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:32.084157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.112538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e9047a762446589902267900c8a4a6', 'request_id': 'req-0873164a-aedf-4623-9557-7c4421497b6e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.129339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e9047a762446589902267900c8a4a6', 'request_id': 'req-0873164a-aedf-4623-9557-7c4421497b6e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.149444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] The token cache is being invalidate because project a2e9047a762446589902267900c8a4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:32.149752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.150439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.155764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1071/2169] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:31 2022] DELETE /identity/v3/projects/a2e9047a762446589902267900c8a4a6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:32.156793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:32.158365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.224339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1099/2170] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:32.225219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:32.226509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.273080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873164a-aedf-4623-9557-7c4421497b6e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:32.283138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:32.283959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.284170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.284641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] PATH_INFO: `/v3/projects/10372445c3c34afcbbd0eea1b9972f3f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:32.290252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10372445c3c34afcbbd0eea1b9972f3f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:32.292377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:32.323607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:32.339312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68faee-c7a1-4c70-8d35-d9dfeedc09ef None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:32.345613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:32.346476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.346881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.347836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] PATH_INFO: `/v3/users/bb10000fc4ae46f0b967c7621a477e34` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:32.348784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb10000fc4ae46f0b967c7621a477e34)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:32.351124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:32.366323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10372445c3c34afcbbd0eea1b9972f3f', 'request_id': 'req-a53421ce-2c8c-4971-821d-522534245d6c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.375000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10372445c3c34afcbbd0eea1b9972f3f', 'request_id': 'req-a53421ce-2c8c-4971-821d-522534245d6c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.380849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:32.391841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10372445c3c34afcbbd0eea1b9972f3f', 'request_id': 'req-a53421ce-2c8c-4971-821d-522534245d6c'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.418764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] The token cache is being invalidate because project 10372445c3c34afcbbd0eea1b9972f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:32.420409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.421184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb10000fc4ae46f0b967c7621a477e34'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.421316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.422145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb10000fc4ae46f0b967c7621a477e34'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.426857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1072/2171] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:32 2022] DELETE /identity/v3/projects/10372445c3c34afcbbd0eea1b9972f3f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:32.427836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:32.429600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.450966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb10000fc4ae46f0b967c7621a477e34'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.461998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb10000fc4ae46f0b967c7621a477e34'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.462880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb10000fc4ae46f0b967c7621a477e34'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:32.489968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1100/2172] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:32 2022] DELETE /identity/v3/users/bb10000fc4ae46f0b967c7621a477e34 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:32.491083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:32.492871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.542124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53421ce-2c8c-4971-821d-522534245d6c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:32.642101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361302-6058-4520-bd0e-64d4dab44fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:32.642849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361302-6058-4520-bd0e-64d4dab44fcf service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.643253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361302-6058-4520-bd0e-64d4dab44fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.643666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361302-6058-4520-bd0e-64d4dab44fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:32.651625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11361302-6058-4520-bd0e-64d4dab44fcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.658453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f0b0c-c78d-4433-89c9-e3b8310e06cd admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:32.674340 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a22a64-52e6-4c9a-b451-d2fc9845403d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:32.675042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22a64-52e6-4c9a-b451-d2fc9845403d service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.675327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22a64-52e6-4c9a-b451-d2fc9845403d service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.675629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22a64-52e6-4c9a-b451-d2fc9845403d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:32.678821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d9a22a64-52e6-4c9a-b451-d2fc9845403d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.788752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a22a64-52e6-4c9a-b451-d2fc9845403d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:32.791781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a22a64-52e6-4c9a-b451-d2fc9845403d service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:32.807554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1101/2173] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:32.809262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca24d54-5f9c-458e-904b-528625215bd6 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.810258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca24d54-5f9c-458e-904b-528625215bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.810858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca24d54-5f9c-458e-904b-528625215bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:32.824974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361302-6058-4520-bd0e-64d4dab44fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:32.833434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361302-6058-4520-bd0e-64d4dab44fcf service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:32.845252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1073/2174] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:32.848514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-fca24d54-5f9c-458e-904b-528625215bd6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:32.853823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fca24d54-5f9c-458e-904b-528625215bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:32.935829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:32.998867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:32.999426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:32.999426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.003631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1102/2175] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:33.029559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:33.031238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:33.052181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1074/2176] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:33.055888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca24d54-5f9c-458e-904b-528625215bd6 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.079476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca24d54-5f9c-458e-904b-528625215bd6 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.112091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.127189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.127528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.127840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.130472 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:33.130790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.132489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.148025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.148025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:33.182159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1103/2177] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:39:33.188693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.189442 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a23311-a447-41e5-ab2b-f20461f998a2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.213756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.228322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.228322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.228322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] PATH_INFO: `/v3/projects/17898eccd52440d0a05b60ed7cf76146` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.228322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=17898eccd52440d0a05b60ed7cf76146)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.228322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.228322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:33.242382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2741e-b3f7-44ac-8f13-4b28bc7e67d9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.249501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.250376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.250886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.251380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.252262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.255263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.316122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1104/2178] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:33 2022] POST /identity/v3/projects => generated 397 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:33.317149 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.358795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17898eccd52440d0a05b60ed7cf76146', 'request_id': 'req-fb6e7e94-d656-4737-81de-fd4a9975ecbc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.368848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17898eccd52440d0a05b60ed7cf76146', 'request_id': 'req-fb6e7e94-d656-4737-81de-fd4a9975ecbc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.382170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17898eccd52440d0a05b60ed7cf76146', 'request_id': 'req-fb6e7e94-d656-4737-81de-fd4a9975ecbc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.401835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] The token cache is being invalidate because project 17898eccd52440d0a05b60ed7cf76146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:33.402181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.402877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.407930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1075/2179] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:33 2022] DELETE /identity/v3/projects/17898eccd52440d0a05b60ed7cf76146 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:33.409024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.411342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:33.470544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224096-61df-45b8-ad4c-d80f9ab42e59 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.542642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e7e94-d656-4737-81de-fd4a9975ecbc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.557791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.561450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.562470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.563880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] PATH_INFO: `/v3/users/e250de08b8d84ed08b0d1b75ff027eb3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.568732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e250de08b8d84ed08b0d1b75ff027eb3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.573143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.575715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.576789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.576960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.577291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.577943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.580040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.609686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1105/2180] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:33 2022] POST /identity/v3/users => generated 299 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:33.614280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.625266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:33.642414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73762b9-1bb0-424b-88a2-6c93ae8cbe75 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.648556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.649052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.649530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.649882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.650894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.652938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.679460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1106/2181] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:33.680510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.681658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e250de08b8d84ed08b0d1b75ff027eb3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.684303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e250de08b8d84ed08b0d1b75ff027eb3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.686023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e250de08b8d84ed08b0d1b75ff027eb3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.692623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851680c-b0ea-48fe-87c0-e72e3b8b68e0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.697557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e250de08b8d84ed08b0d1b75ff027eb3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.698991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.699888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.700339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.701801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.702817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.705173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.715676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bf65e0cc-51a0-4f48-aed7-b07aa710c2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e250de08b8d84ed08b0d1b75ff027eb3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:33.721635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1107/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:33.725765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:33.727718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:33.749908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba3873-97af-411e-83b6-785190164004 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:33.752975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1076/2183] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:33 2022] DELETE /identity/v3/users/e250de08b8d84ed08b0d1b75ff027eb3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:33.788584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:33.835712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.836098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.836284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.869465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] MFA Rules not processed for user `96e9216d8a994f03b50eb64fa6516f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:33.870714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:33.876160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:33.917545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5751-5bf8-430b-8f35-cbeb33237639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:33.919118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5751-5bf8-430b-8f35-cbeb33237639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:33.920176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5751-5bf8-430b-8f35-cbeb33237639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:33.920566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5751-5bf8-430b-8f35-cbeb33237639 admin admin] PATH_INFO: `/v3/projects/b63a226da6684719ac536a1d2f4ffe70/users/139a109b3cff4d788011e0fd215cf752/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:33.952808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5751-5bf8-430b-8f35-cbeb33237639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63a226da6684719ac536a1d2f4ffe70, user_id=139a109b3cff4d788011e0fd215cf752, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:33.957495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5751-5bf8-430b-8f35-cbeb33237639 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:33.987303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1108/2184] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:33 2022] PUT /identity/v3/projects/b63a226da6684719ac536a1d2f4ffe70/users/139a109b3cff4d788011e0fd215cf752/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:34.000785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:34.001488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:34.001969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:34.005710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1077/2185] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:34.118140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] MFA Rules not processed for user `139a109b3cff4d788011e0fd215cf752`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:34.119290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:34.327902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1109/2186] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:34.336676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:34.340301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:34.497642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:34.500220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:34.516103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03475-a912-4537-b708-1d1f6e530a9f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:34.680455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303432e6-724d-45ba-b085-36a788462c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:34.681117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303432e6-724d-45ba-b085-36a788462c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:34.682880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96d9d6-6f3e-46d8-97ff-baa735d60a01 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:34.683031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303432e6-724d-45ba-b085-36a788462c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:34.683202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303432e6-724d-45ba-b085-36a788462c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:34.693377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:34.694147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:34.694423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:34.694696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] PATH_INFO: `/v3/projects/b0d27a07c6aa4d619ab67bbf18a4386a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:34.695875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d27a07c6aa4d619ab67bbf18a4386a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:34.701570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:34.704266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303432e6-724d-45ba-b085-36a788462c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:34.708801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303432e6-724d-45ba-b085-36a788462c84 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:34.769660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1078/2187] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:34.782611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:34.814012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d27a07c6aa4d619ab67bbf18a4386a', 'request_id': 'req-f1c1e622-a758-4508-882d-eb8fac43f705'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:34.826036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d27a07c6aa4d619ab67bbf18a4386a', 'request_id': 'req-f1c1e622-a758-4508-882d-eb8fac43f705'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:34.839383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d27a07c6aa4d619ab67bbf18a4386a', 'request_id': 'req-f1c1e622-a758-4508-882d-eb8fac43f705'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:34.865651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] The token cache is being invalidate because project b0d27a07c6aa4d619ab67bbf18a4386a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:34.865959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:34.866767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f1c1e622-a758-4508-882d-eb8fac43f705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:34.874857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1110/2188] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:34 2022] DELETE /identity/v3/projects/b0d27a07c6aa4d619ab67bbf18a4386a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:34.876496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef8bc3-baf9-46b9-9960-b1c495bd9c26 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:34.876763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef8bc3-baf9-46b9-9960-b1c495bd9c26 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:34.877041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef8bc3-baf9-46b9-9960-b1c495bd9c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:34.910126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2fef8bc3-baf9-46b9-9960-b1c495bd9c26 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:34.911644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2fef8bc3-baf9-46b9-9960-b1c495bd9c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:35.025654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1079/2189] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:35.034926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac31d-3bcd-4e55-b47e-c3830a2ae3db None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.035211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac31d-3bcd-4e55-b47e-c3830a2ae3db None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.035486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ac31d-3bcd-4e55-b47e-c3830a2ae3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:35.081292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c31ac31d-3bcd-4e55-b47e-c3830a2ae3db None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:35.089298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c31ac31d-3bcd-4e55-b47e-c3830a2ae3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:35.105888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1111/2190] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:35.112800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef8bc3-baf9-46b9-9960-b1c495bd9c26 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:35.138692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef8bc3-baf9-46b9-9960-b1c495bd9c26 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:35.160732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:35.164558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.167479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.167822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:35.171073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:35.171405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:35.173100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:35.213873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:35.228273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1080/2191] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:35.233066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ac31d-3bcd-4e55-b47e-c3830a2ae3db None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:35.247083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ac31d-3bcd-4e55-b47e-c3830a2ae3db None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:35.265416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:35.266996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.267333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.267784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:35.268539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:35.270875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:35.351172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1112/2192] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:35 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:35.355227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:35.380437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad096-94af-46bd-9aa6-1287319b61b3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:35.563860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:35.564514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.564791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.565071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:35.565797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:35.567874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:35.613643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1081/2193] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:35 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:35.614821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:35.630511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85b652-c5a3-4ebd-97d2-7936d71eeed8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:35.648780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:35.649869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.650538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.651031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:35.652116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:35.654710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:35.682086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1113/2194] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:35.686834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:35.717484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30aac-a9bd-4bac-967a-8719d0472b59 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:35.730938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af5a6-eec7-440a-a54c-16284fa091c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:35.732598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af5a6-eec7-440a-a54c-16284fa091c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.735138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af5a6-eec7-440a-a54c-16284fa091c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.735936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af5a6-eec7-440a-a54c-16284fa091c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:35.737159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af5a6-eec7-440a-a54c-16284fa091c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:35.740494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af5a6-eec7-440a-a54c-16284fa091c3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:35.771275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1082/2195] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:35.776310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:35.790202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b04ee-f69f-4c47-8cd0-9b855aaba0d9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:35.798267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:35.799294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.799931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.800414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] PATH_INFO: `/v3/projects/599ec2434436448f8446347434ca662c/users/144af1ca8c294285a54b5378ee7a08f9/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:35.824297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=599ec2434436448f8446347434ca662c, user_id=144af1ca8c294285a54b5378ee7a08f9, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:35.828310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:35.910201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1114/2196] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:35 2022] PUT /identity/v3/projects/599ec2434436448f8446347434ca662c/users/144af1ca8c294285a54b5378ee7a08f9/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:35.921612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:35.925149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:35.925534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:36.036401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] MFA Rules not processed for user `144af1ca8c294285a54b5378ee7a08f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:36.038710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:36.225543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1083/2197] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:36.239664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:36.242139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:36.358758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd444b82-d616-44b7-8af8-50017421d12f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:36.363428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e34d3-77f9-45c3-86bc-92fbe6ac72d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:36.364407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e34d3-77f9-45c3-86bc-92fbe6ac72d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:36.364855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e34d3-77f9-45c3-86bc-92fbe6ac72d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:36.365353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e34d3-77f9-45c3-86bc-92fbe6ac72d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:36.402678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e34d3-77f9-45c3-86bc-92fbe6ac72d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:36.408266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e34d3-77f9-45c3-86bc-92fbe6ac72d7 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:36.439388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1115/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:37.873417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:37.877506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:37.982687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5025734-b1d4-47e2-a511-5aa1e8c330c3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:37.987932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:37.988685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:37.989102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:37.989470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] PATH_INFO: `/v3/users/fe560c62ed394f44985c864ee35f6fea` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:37.991573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe560c62ed394f44985c864ee35f6fea)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:37.992672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:38.019047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:38.136020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe560c62ed394f44985c864ee35f6fea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:38.137692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe560c62ed394f44985c864ee35f6fea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:38.142219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe560c62ed394f44985c864ee35f6fea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:38.157800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe560c62ed394f44985c864ee35f6fea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:38.209740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:38.210597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:38.211613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:38.216178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bcf49113-decd-49b1-8938-1f265263d6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe560c62ed394f44985c864ee35f6fea'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:38.246904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] MFA Rules not processed for user `144af1ca8c294285a54b5378ee7a08f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:38.247322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1084/2199] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:37 2022] DELETE /identity/v3/users/fe560c62ed394f44985c864ee35f6fea => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:38.251847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:38.252340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:38.252776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:38.257561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:38.297227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:38.301988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:38.393788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1116/2200] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:38.463313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1085/2201] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:38.476927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:38.479171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:38.484750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:38.580813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408c9e5-0cab-4e0e-a4c5-46994eeca93a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:38.595345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:38.596251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:38.596737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:38.597226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:38.611186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:38.613342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:38.631553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1117/2202] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:39.381974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:39.384033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:39.420283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52043-0ec9-478e-8d2a-5782a2530df8 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:39.432091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:39.432891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:39.433294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:39.433700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] PATH_INFO: `/v3/projects/1132404dabe44cae9cfc2e9a02aef227` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:39.436268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1132404dabe44cae9cfc2e9a02aef227)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:39.439043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:39.513607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1132404dabe44cae9cfc2e9a02aef227', 'request_id': 'req-3ac65d79-f278-4155-b15d-32d6bd5353b8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.522629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1132404dabe44cae9cfc2e9a02aef227', 'request_id': 'req-3ac65d79-f278-4155-b15d-32d6bd5353b8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.538033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1132404dabe44cae9cfc2e9a02aef227', 'request_id': 'req-3ac65d79-f278-4155-b15d-32d6bd5353b8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.553599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] The token cache is being invalidate because project 1132404dabe44cae9cfc2e9a02aef227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:39.554228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.555302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.557081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1086/2203] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:39 2022] DELETE /identity/v3/projects/1132404dabe44cae9cfc2e9a02aef227 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:39.563370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:39.580941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e4b5c-d9d0-4ae3-9875-3a8a80da52ae service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:39.678867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:39.679837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:39.680113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:39.680614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] PATH_INFO: `/v3/users/ebe0703b232346569fad7f4ae2d24448` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:39.681990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebe0703b232346569fad7f4ae2d24448)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:39.684273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:39.748035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebe0703b232346569fad7f4ae2d24448'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.748876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebe0703b232346569fad7f4ae2d24448'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.764130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebe0703b232346569fad7f4ae2d24448'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.772339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebe0703b232346569fad7f4ae2d24448'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.773137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c2647e04-dbb6-4c93-a861-ca3c2c6a0412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebe0703b232346569fad7f4ae2d24448'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:39.791630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1118/2204] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:39 2022] DELETE /identity/v3/users/ebe0703b232346569fad7f4ae2d24448 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:40.188108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:40.189600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:40.213270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac65d79-f278-4155-b15d-32d6bd5353b8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:40.228884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:40.283407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:40.284083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.284369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.284646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] PATH_INFO: `/v3/projects/0c0bbe1a67d24b8abbb144a14da6dfb9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.285804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0bbe1a67d24b8abbb144a14da6dfb9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:40.287761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:40.337866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0bbe1a67d24b8abbb144a14da6dfb9', 'request_id': 'req-eb62f284-54e4-463e-be14-859ac17c78b8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:40.346563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0bbe1a67d24b8abbb144a14da6dfb9', 'request_id': 'req-eb62f284-54e4-463e-be14-859ac17c78b8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:40.362344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0bbe1a67d24b8abbb144a14da6dfb9', 'request_id': 'req-eb62f284-54e4-463e-be14-859ac17c78b8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:40.379802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] The token cache is being invalidate because project 0c0bbe1a67d24b8abbb144a14da6dfb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:40.380203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:40.381261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-eb62f284-54e4-463e-be14-859ac17c78b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:40.387447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1087/2205] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:40 2022] DELETE /identity/v3/projects/0c0bbe1a67d24b8abbb144a14da6dfb9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:40.389757 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220147c3-00be-48fe-913e-c58beca46119 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.390728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220147c3-00be-48fe-913e-c58beca46119 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.391186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220147c3-00be-48fe-913e-c58beca46119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.420840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-220147c3-00be-48fe-913e-c58beca46119 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:40.422162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-220147c3-00be-48fe-913e-c58beca46119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:40.447076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:40.535261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1119/2206] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:40.543787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3139d5-e723-4640-b578-b0fe7f15d805 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.544651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3139d5-e723-4640-b578-b0fe7f15d805 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.545142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3139d5-e723-4640-b578-b0fe7f15d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.569321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ac3139d5-e723-4640-b578-b0fe7f15d805 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:40.570807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ac3139d5-e723-4640-b578-b0fe7f15d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:40.592411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1088/2207] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:40.593874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220147c3-00be-48fe-913e-c58beca46119 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:40.605313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220147c3-00be-48fe-913e-c58beca46119 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:40.616377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:40.619146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.620153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.620720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.622287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:40.638193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:40.642158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:40.680259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1120/2208] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:40.681411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3139d5-e723-4640-b578-b0fe7f15d805 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:40.695621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3139d5-e723-4640-b578-b0fe7f15d805 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:40.706919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:40.708010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.708386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.708752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.710195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:40.712761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:40.752181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1089/2209] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:40 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:40.756908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:40.770515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abac7b-6024-4276-b0c1-6caa6b129cb6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:40.850297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:40.850918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.851201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.851561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.852239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:40.854848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:40.882680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1121/2210] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:40 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:40.884475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:40.896812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea198dd2-f346-4b70-941d-e4150f36c49d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:40.902605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:40.904781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.905577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.905577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.906072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:40.907844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:40.931877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1090/2211] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:40.933972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:40.947065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f00ba-c85f-464b-9153-65d3ff7c7e2f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:40.954152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:40.955229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:40.955729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:40.956104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:40.956869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:40.960061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:40.991832 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1122/2212] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:40.997742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:41.021475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61196bd3-7f53-4dab-b524-eaa4cea04c89 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:41.036408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aa46a-f7cb-4747-8e22-fa59b7f92321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:41.037247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aa46a-f7cb-4747-8e22-fa59b7f92321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.037677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aa46a-f7cb-4747-8e22-fa59b7f92321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.038083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aa46a-f7cb-4747-8e22-fa59b7f92321 admin admin] PATH_INFO: `/v3/projects/cee6ef6a42e045a189950a5d01a4c849/users/26d6ff58efdf42a781d392d66deab291/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.039632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:41.041542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.055738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee05fc-4591-483c-986d-650b6d5c24d6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:41.061974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:41.063023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.063610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.064235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] PATH_INFO: `/v3/users/139a109b3cff4d788011e0fd215cf752` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.065425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139a109b3cff4d788011e0fd215cf752)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:41.067370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:41.079523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aa46a-f7cb-4747-8e22-fa59b7f92321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee6ef6a42e045a189950a5d01a4c849, user_id=26d6ff58efdf42a781d392d66deab291, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:41.083309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aa46a-f7cb-4747-8e22-fa59b7f92321 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:41.119304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1091/2213] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:40 2022] PUT /identity/v3/projects/cee6ef6a42e045a189950a5d01a4c849/users/26d6ff58efdf42a781d392d66deab291/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:41.121283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.121968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.122412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.152613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139a109b3cff4d788011e0fd215cf752'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.154116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139a109b3cff4d788011e0fd215cf752'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.161078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] MFA Rules not processed for user `26d6ff58efdf42a781d392d66deab291`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:41.162422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.171968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139a109b3cff4d788011e0fd215cf752'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.180540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139a109b3cff4d788011e0fd215cf752'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.181648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-85980d01-e24c-4377-9ffe-df4cea7bcac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139a109b3cff4d788011e0fd215cf752'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.201605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1123/2214] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:41 2022] DELETE /identity/v3/users/139a109b3cff4d788011e0fd215cf752 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:41.202854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:41.204371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.204721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.207179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.217646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:41.234930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:41.236518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.269990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1092/2215] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:41.285566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:41.287570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.386489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1124/2216] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:41.401332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:41.402854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.430696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647038a-58ae-49f5-9c9d-73a08da94621 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:41.503241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2aa8f-79f1-4b1b-94d8-e37d83869fe1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:41.519616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:41.519616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.519616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.519616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.538021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:41.545265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:41.549679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0330b-3aa6-4bd4-95ba-359b0fed4732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:41.550554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0330b-3aa6-4bd4-95ba-359b0fed4732 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.551192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0330b-3aa6-4bd4-95ba-359b0fed4732 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.552002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0330b-3aa6-4bd4-95ba-359b0fed4732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.576030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1125/2217] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:41.648667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0330b-3aa6-4bd4-95ba-359b0fed4732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:41.650645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0330b-3aa6-4bd4-95ba-359b0fed4732 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:41.668746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1093/2218] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:41.692426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:41.694688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.709479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5664c50-6933-45b0-87b5-a12dcb4a590e service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:41.714555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:41.715488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.716108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.716612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] PATH_INFO: `/v3/users/26d6ff58efdf42a781d392d66deab291` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.717971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d6ff58efdf42a781d392d66deab291)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:41.720139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:41.781415 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d6ff58efdf42a781d392d66deab291'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.782029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d6ff58efdf42a781d392d66deab291'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.796807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d6ff58efdf42a781d392d66deab291'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.808555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d6ff58efdf42a781d392d66deab291'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.809975 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d6ff58efdf42a781d392d66deab291'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:41.827907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1126/2219] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:41 2022] DELETE /identity/v3/users/26d6ff58efdf42a781d392d66deab291 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:41.832714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:41.832993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:41.833274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:41.860455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:41.862256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.899581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:41.938479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1094/2220] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:41.948332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:41.950807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:41.971695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:42.023996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c5fe-b7f5-4c21-afba-84c428ae2ee2 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:42.028731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:42.029454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.029742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.030017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.040714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:42.042241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:42.067120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1127/2221] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:42.174508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:42.176230 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:42.190121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84df48-8b81-4e1c-a9aa-01a684f507ec None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:42.196379 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:42.197029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.197312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.197584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] PATH_INFO: `/v3/projects/b63a226da6684719ac536a1d2f4ffe70` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.199141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63a226da6684719ac536a1d2f4ffe70)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:42.202349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:42.262876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63a226da6684719ac536a1d2f4ffe70', 'request_id': 'req-2274b040-de58-4274-b41e-0700cdded1d3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.269637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63a226da6684719ac536a1d2f4ffe70', 'request_id': 'req-2274b040-de58-4274-b41e-0700cdded1d3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.277759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63a226da6684719ac536a1d2f4ffe70', 'request_id': 'req-2274b040-de58-4274-b41e-0700cdded1d3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.291977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] The token cache is being invalidate because project b63a226da6684719ac536a1d2f4ffe70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:42.292272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.292927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2274b040-de58-4274-b41e-0700cdded1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.295029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1095/2222] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:42 2022] DELETE /identity/v3/projects/b63a226da6684719ac536a1d2f4ffe70 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:42.472117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:42.474028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:42.488105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0d0c-e0d8-441c-ba96-f27ac35500be service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:42.560679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:42.561400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.561818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.562147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] PATH_INFO: `/v3/projects/cee6ef6a42e045a189950a5d01a4c849` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.563370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee6ef6a42e045a189950a5d01a4c849)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:42.565579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:42.626684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee6ef6a42e045a189950a5d01a4c849', 'request_id': 'req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.632617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee6ef6a42e045a189950a5d01a4c849', 'request_id': 'req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.639470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee6ef6a42e045a189950a5d01a4c849', 'request_id': 'req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.653589 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] The token cache is being invalidate because project cee6ef6a42e045a189950a5d01a4c849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:42.654043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.654743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e0fdc30c-a679-4d77-99be-c872a6d3cf8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:42.656373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1128/2223] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:42 2022] DELETE /identity/v3/projects/cee6ef6a42e045a189950a5d01a4c849 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:42.661241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ad88c-7eb7-4239-86c8-f55bb79662a7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.661722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ad88c-7eb7-4239-86c8-f55bb79662a7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.661830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ad88c-7eb7-4239-86c8-f55bb79662a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.682007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8d2ad88c-7eb7-4239-86c8-f55bb79662a7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:42.683224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8d2ad88c-7eb7-4239-86c8-f55bb79662a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:42.744247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1096/2224] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:42.752040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9856c-70d4-48b3-8e99-b2112e2eaa8f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.752521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9856c-70d4-48b3-8e99-b2112e2eaa8f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.752638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9856c-70d4-48b3-8e99-b2112e2eaa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.772641 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-49e9856c-70d4-48b3-8e99-b2112e2eaa8f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:42.773857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-49e9856c-70d4-48b3-8e99-b2112e2eaa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:42.782302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1129/2225] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:42.786541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ad88c-7eb7-4239-86c8-f55bb79662a7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:42.796248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ad88c-7eb7-4239-86c8-f55bb79662a7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:42.800842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:42.801443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.801729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.802005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.802649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:42.802956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:42.804594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:42.820586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1097/2226] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:42.824163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9856c-70d4-48b3-8e99-b2112e2eaa8f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:42.834059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9856c-70d4-48b3-8e99-b2112e2eaa8f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:42.839333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:42.840256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.841245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.841830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.842624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:42.844760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:42.883465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1130/2227] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:42 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:42.884788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:42.900014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639076d-fb6c-44ac-89fa-0f6acfa36d9a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:42.959414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:42.988465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:42.989495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:42.989495 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:42.989716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:42.990272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:42.992428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:43.032184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1098/2228] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:42 2022] POST /identity/v3/users => generated 281 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:43.035459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:43.054909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce38c46-8612-47f5-b3d6-b491b10e7cca admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:43.065445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:43.066357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.067305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.067828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.069199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:43.072464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:43.087682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1131/2229] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:43.093143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:43.105374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32405954-7a98-49c2-a6e9-824458c33e10 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:43.111123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db864e16-d9db-485c-a650-07ff6bc5968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:43.111835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864e16-d9db-485c-a650-07ff6bc5968f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.112125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864e16-d9db-485c-a650-07ff6bc5968f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.112404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db864e16-d9db-485c-a650-07ff6bc5968f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.113066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db864e16-d9db-485c-a650-07ff6bc5968f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:43.118671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db864e16-d9db-485c-a650-07ff6bc5968f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:43.141638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1099/2230] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:43.146479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:43.163015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c6d9-7402-4d57-ada2-803b25039270 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:43.169320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:43.170094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.170458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.170792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] PATH_INFO: `/v3/projects/a495f3a6612147ca8ca06319b54b0bbb/users/712f7e72ec3d458da331ca9b550b4611/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.180166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:43.188555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a495f3a6612147ca8ca06319b54b0bbb, user_id=712f7e72ec3d458da331ca9b550b4611, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:43.192594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:43.209568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1132/2231] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:43 2022] PUT /identity/v3/projects/a495f3a6612147ca8ca06319b54b0bbb/users/712f7e72ec3d458da331ca9b550b4611/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:43.219874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8cb7-dfb3-4090-9054-d47c124d1740 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.220163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8cb7-dfb3-4090-9054-d47c124d1740 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.220439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8cb7-dfb3-4090-9054-d47c124d1740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.251030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-c0ee8cb7-dfb3-4090-9054-d47c124d1740 None None] MFA Rules not processed for user `712f7e72ec3d458da331ca9b550b4611`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:43.252367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c0ee8cb7-dfb3-4090-9054-d47c124d1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:43.329799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1100/2232] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:43.366072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:43.368037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:43.433183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae17d-d555-4330-b628-e8b34e7765f2 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:43.439112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b3275-07c0-4b09-b588-4f140485d3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:43.440167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3275-07c0-4b09-b588-4f140485d3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.440519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3275-07c0-4b09-b588-4f140485d3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.440841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b3275-07c0-4b09-b588-4f140485d3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.456455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3275-07c0-4b09-b588-4f140485d3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:43.457965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b3275-07c0-4b09-b588-4f140485d3b0 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:43.472014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1133/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:43.497264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8cb7-dfb3-4090-9054-d47c124d1740 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:43.566428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8cb7-dfb3-4090-9054-d47c124d1740 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:43.571203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:43.571874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.572163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.572446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] PATH_INFO: `/v3/users/712f7e72ec3d458da331ca9b550b4611` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.573601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712f7e72ec3d458da331ca9b550b4611)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:43.576154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:43.628801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712f7e72ec3d458da331ca9b550b4611'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:43.629687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712f7e72ec3d458da331ca9b550b4611'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:43.630343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712f7e72ec3d458da331ca9b550b4611'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:43.638026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712f7e72ec3d458da331ca9b550b4611'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:43.640184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:43.652480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712f7e72ec3d458da331ca9b550b4611'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:43.666003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1101/2234] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:43 2022] DELETE /identity/v3/users/712f7e72ec3d458da331ca9b550b4611 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:43.670506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.670798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.671082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.702135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:43.703408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:43.771694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1134/2235] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:43.786516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:43.788003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:43.873377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06cae2-54f6-40c6-821e-be15879601c9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:43.877805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e6065-ad9b-4db7-9b50-d4654c24f275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:43.878429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6065-ad9b-4db7-9b50-d4654c24f275 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:43.878717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6065-ad9b-4db7-9b50-d4654c24f275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:43.878994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6065-ad9b-4db7-9b50-d4654c24f275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:43.889798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e6065-ad9b-4db7-9b50-d4654c24f275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:43.891260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e6065-ad9b-4db7-9b50-d4654c24f275 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:43.905539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1102/2236] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:44.291740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:44.293262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:44.308759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e550699-f079-4dd5-823f-edc8338d574a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:44.315619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:44.316305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:44.316590 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:44.317062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] PATH_INFO: `/v3/projects/a495f3a6612147ca8ca06319b54b0bbb` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:44.318357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a495f3a6612147ca8ca06319b54b0bbb)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:44.320378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:44.406639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a495f3a6612147ca8ca06319b54b0bbb', 'request_id': 'req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:44.413395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a495f3a6612147ca8ca06319b54b0bbb', 'request_id': 'req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:44.420271 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a495f3a6612147ca8ca06319b54b0bbb', 'request_id': 'req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:44.442580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] The token cache is being invalidate because project a495f3a6612147ca8ca06319b54b0bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:44.443447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:44.444866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e5fe7928-307b-4bb8-b733-829b9cbc0ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:44.447628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1135/2237] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:44 2022] DELETE /identity/v3/projects/a495f3a6612147ca8ca06319b54b0bbb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:44.453636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb319d-1199-4925-a173-0959ec441a6e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:44.453934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb319d-1199-4925-a173-0959ec441a6e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:44.454347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb319d-1199-4925-a173-0959ec441a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:44.485487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-37bb319d-1199-4925-a173-0959ec441a6e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:44.486665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-37bb319d-1199-4925-a173-0959ec441a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:44.577232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1103/2238] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:44.586984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21d875-c239-4aef-b0b8-33b507a368eb None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:44.586984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21d875-c239-4aef-b0b8-33b507a368eb None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:44.586984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21d875-c239-4aef-b0b8-33b507a368eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:44.609339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ce21d875-c239-4aef-b0b8-33b507a368eb None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:44.610799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ce21d875-c239-4aef-b0b8-33b507a368eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:44.630944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1136/2239] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:44.635386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb319d-1199-4925-a173-0959ec441a6e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:44.650432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb319d-1199-4925-a173-0959ec441a6e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:44.657238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:44.657979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:44.658361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:44.658737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:44.659977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:44.660498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:44.662516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:44.682485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1104/2240] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:44.687421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21d875-c239-4aef-b0b8-33b507a368eb None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:44.700894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21d875-c239-4aef-b0b8-33b507a368eb None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:44.717916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:44.718991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:44.719288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:44.719565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:44.720256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:44.726023 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:44.738996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:44.796067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1137/2241] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:44 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:44.800403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:44.815953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e8c6d-e3d9-44f5-9ced-a6c21ec4a55c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:44.960993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:44.962488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:44.962993 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:44.963490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:44.965336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:44.968768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:44.986671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:45.009335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1105/2242] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:44 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:45.013953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.042936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0702-0da4-43b1-a614-3d0e2be00d84 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.049327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.050262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.050558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.051405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.052127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.054523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.091761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.103747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1138/2243] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:45.112521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079552f4-faa1-48af-a53f-2359f844e4d8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.140720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10150-ad4d-400a-8494-5fe5f0e5b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.141284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10150-ad4d-400a-8494-5fe5f0e5b02e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.141574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10150-ad4d-400a-8494-5fe5f0e5b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.142461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10150-ad4d-400a-8494-5fe5f0e5b02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.143147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b10150-ad4d-400a-8494-5fe5f0e5b02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.145865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b10150-ad4d-400a-8494-5fe5f0e5b02e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.195620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1106/2244] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:45.199961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.212219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fdcd9-e05e-4bbf-8e3d-5e47d53950b4 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.230140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.231788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.232179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.232503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] PATH_INFO: `/v3/projects/b1fbfce635e84f84930b29c1cbf98d7f/users/2968325565b54be59119330907735074/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.271491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fbfce635e84f84930b29c1cbf98d7f, user_id=2968325565b54be59119330907735074, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.276909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.323713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1139/2245] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:45 2022] PUT /identity/v3/projects/b1fbfce635e84f84930b29c1cbf98d7f/users/2968325565b54be59119330907735074/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:45.332967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f97eeb-19a3-4c43-aab9-32bcdd63993f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.333306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f97eeb-19a3-4c43-aab9-32bcdd63993f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.333589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f97eeb-19a3-4c43-aab9-32bcdd63993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.376865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-57f97eeb-19a3-4c43-aab9-32bcdd63993f None None] MFA Rules not processed for user `2968325565b54be59119330907735074`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:45.379786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-57f97eeb-19a3-4c43-aab9-32bcdd63993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:45.508838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1107/2246] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:45.514525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.581095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4667-fdcd-4616-8c07-8dfedea8ce7d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.585835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.586450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.586734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.587008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.587714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.589644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.617441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1140/2247] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:45 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:45.621756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f97eeb-19a3-4c43-aab9-32bcdd63993f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.632813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f97eeb-19a3-4c43-aab9-32bcdd63993f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.690938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.691550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.691749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.692024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.692648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.694712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.716445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1108/2248] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:45 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:45.720448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.730571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b82699-64a6-4c89-a73f-19a931ce99a6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.735991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.736582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.736860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.737134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.737767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.739379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.749732 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1141/2249] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:45.753670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.764429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c178137-b624-45b8-8b42-cd9a7094168c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.769114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbf60a-84cd-4340-809a-6e593716c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.769698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbf60a-84cd-4340-809a-6e593716c219 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.769981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbf60a-84cd-4340-809a-6e593716c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.770256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbf60a-84cd-4340-809a-6e593716c219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.770896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbf60a-84cd-4340-809a-6e593716c219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.772516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbf60a-84cd-4340-809a-6e593716c219 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.782964 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1109/2250] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:45.786824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:45.797088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd94f5-44d9-4db5-a459-d170aa311c8d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:45.801950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:45.802605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.802885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.803157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] PATH_INFO: `/v3/projects/f204b12984294e89802a9908bf416984/users/35578019fe9347dd9ac9aa26e69bc335/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.818120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f204b12984294e89802a9908bf416984, user_id=35578019fe9347dd9ac9aa26e69bc335, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:45.820811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:45.834696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1142/2251] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:45 2022] PUT /identity/v3/projects/f204b12984294e89802a9908bf416984/users/35578019fe9347dd9ac9aa26e69bc335/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:45.845638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4a8d-2585-4d67-ba37-b4ba12455a9f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:45.845923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4a8d-2585-4d67-ba37-b4ba12455a9f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:45.846199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4a8d-2585-4d67-ba37-b4ba12455a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:45.874419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-aa2d4a8d-2585-4d67-ba37-b4ba12455a9f None None] MFA Rules not processed for user `35578019fe9347dd9ac9aa26e69bc335`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:45.875657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-aa2d4a8d-2585-4d67-ba37-b4ba12455a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:45.918250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:45.946370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1110/2252] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:45.951671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.013881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ae11-2240-4674-9d6d-700cae937ea1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.018522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.019153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.019436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.019742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.020418 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.022397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.026800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:46.050603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1143/2253] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:45 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:46.054680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d4a8d-2585-4d67-ba37-b4ba12455a9f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.065905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d4a8d-2585-4d67-ba37-b4ba12455a9f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.123257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.123906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.124193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.124470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.125112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.127080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.149524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1111/2254] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:46 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:46.153603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.164306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b5b53-98eb-46a7-b9b3-e54716776eb9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.169062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.169670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.169954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.170233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.170957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.172638 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.174157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.175877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:46.187201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1144/2255] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:46.188267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.188505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7792e03-f7e3-4a54-b7d5-37169860e7a5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.193308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.193947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.194236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.194518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] PATH_INFO: `/v3/users/801c1edec56e4532b0c8f04adab5119e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.195705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=801c1edec56e4532b0c8f04adab5119e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.197872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.198333 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc82cd-38f4-4850-ad71-e8c7371de6f1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.204114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.204761 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.205520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.205520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] PATH_INFO: `/v3/projects/9bb1c601c41a44668580474841d39c11/users/bf34edcb050841798fd41bd8dcbfda51/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.220246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb1c601c41a44668580474841d39c11, user_id=bf34edcb050841798fd41bd8dcbfda51, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.222928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.237885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1145/2256] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:46 2022] PUT /identity/v3/projects/9bb1c601c41a44668580474841d39c11/users/bf34edcb050841798fd41bd8dcbfda51/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:46.241648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.257520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801c1edec56e4532b0c8f04adab5119e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:46.258357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801c1edec56e4532b0c8f04adab5119e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:46.259051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801c1edec56e4532b0c8f04adab5119e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:46.267537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801c1edec56e4532b0c8f04adab5119e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:46.282096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f8a4794e-4af7-4b92-9327-d8bb247ab07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801c1edec56e4532b0c8f04adab5119e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:46.299361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1112/2257] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:46 2022] DELETE /identity/v3/users/801c1edec56e4532b0c8f04adab5119e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:46.303305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.303930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.303930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.321223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a3817-6e78-4098-8947-f66820c66287 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.323627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:46.324858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:46.369563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:46.399121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1113/2258] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:46.405629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.406364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.407237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.407655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.409463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.410853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:46.412222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.414808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.443348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1146/2259] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:46.448564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.451856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:46.466012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd05d7d-e6ad-45f2-8ca2-0a1fac8c0424 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.471466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386363ba-18e9-44fb-bf13-c6e8fac1103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.472303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386363ba-18e9-44fb-bf13-c6e8fac1103b admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.472611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386363ba-18e9-44fb-bf13-c6e8fac1103b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.472888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386363ba-18e9-44fb-bf13-c6e8fac1103b admin admin] PATH_INFO: `/v3/projects/9bb1c601c41a44668580474841d39c11/users/bf34edcb050841798fd41bd8dcbfda51/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.474985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386363ba-18e9-44fb-bf13-c6e8fac1103b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb1c601c41a44668580474841d39c11, user_id=bf34edcb050841798fd41bd8dcbfda51, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.477966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386363ba-18e9-44fb-bf13-c6e8fac1103b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.502795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1147/2260] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:46 2022] PUT /identity/v3/projects/9bb1c601c41a44668580474841d39c11/users/bf34edcb050841798fd41bd8dcbfda51/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:46.505808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.506103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.507265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.521576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b838f3-9889-41c7-a3d9-890d8b3b59e3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.585047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] MFA Rules not processed for user `bf34edcb050841798fd41bd8dcbfda51`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:46.586314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:46.609071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.609958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.610251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.610519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.635905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:46.682296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1148/2261] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:46.696904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:46.698867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:46.699316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.701187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.714172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1114/2262] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:46.793243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242bc59-a859-47cc-9fc5-134e96d10467 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:46.801011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d74e-4ed1-4e12-936f-a03f44dec8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:46.802136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d74e-4ed1-4e12-936f-a03f44dec8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:46.802895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d74e-4ed1-4e12-936f-a03f44dec8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:46.803306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d74e-4ed1-4e12-936f-a03f44dec8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:46.805945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0958d74e-4ed1-4e12-936f-a03f44dec8d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:46.907668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d74e-4ed1-4e12-936f-a03f44dec8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:46.909253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d74e-4ed1-4e12-936f-a03f44dec8d0 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:46.919569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1149/2263] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:39:47.076155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.077645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:47.093900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27533959-5f36-43e6-a51b-16721e992024 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:47.102612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:47.103353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.103724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.104012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] PATH_INFO: `/v3/projects/c91d1a999b034967bab9fdbfbd5486c2` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.105174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91d1a999b034967bab9fdbfbd5486c2)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:47.108353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:47.168603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:47.172380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91d1a999b034967bab9fdbfbd5486c2', 'request_id': 'req-40bc8adb-2325-42c2-9f56-0ac5450e88b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:47.181879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91d1a999b034967bab9fdbfbd5486c2', 'request_id': 'req-40bc8adb-2325-42c2-9f56-0ac5450e88b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:47.191212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91d1a999b034967bab9fdbfbd5486c2', 'request_id': 'req-40bc8adb-2325-42c2-9f56-0ac5450e88b4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:47.213488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] The token cache is being invalidate because project c91d1a999b034967bab9fdbfbd5486c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:47.214103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:47.214608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-40bc8adb-2325-42c2-9f56-0ac5450e88b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:47.216564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1115/2264] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:47 2022] DELETE /identity/v3/projects/c91d1a999b034967bab9fdbfbd5486c2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:47.221626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03150-999c-416a-b5fd-ab5a7e5a9279 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.222854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03150-999c-416a-b5fd-ab5a7e5a9279 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.223173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df03150-999c-416a-b5fd-ab5a7e5a9279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.250608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-8df03150-999c-416a-b5fd-ab5a7e5a9279 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:47.251549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8df03150-999c-416a-b5fd-ab5a7e5a9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:47.337114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1150/2265] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:39:47.345153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cec68-3f7d-4fb3-b6bf-c9c5a7076894 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.345457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cec68-3f7d-4fb3-b6bf-c9c5a7076894 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.345729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cec68-3f7d-4fb3-b6bf-c9c5a7076894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.365846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0a1cec68-3f7d-4fb3-b6bf-c9c5a7076894 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:47.367071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0a1cec68-3f7d-4fb3-b6bf-c9c5a7076894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:47.376048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1116/2266] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:47.380594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df03150-999c-416a-b5fd-ab5a7e5a9279 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.390470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df03150-999c-416a-b5fd-ab5a7e5a9279 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:47.395029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:47.395665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.395954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.396233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.396884 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:39:47.397191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:47.398799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:47.410299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1151/2267] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:39:47.414597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cec68-3f7d-4fb3-b6bf-c9c5a7076894 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.424381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cec68-3f7d-4fb3-b6bf-c9c5a7076894 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:47.429001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:47.429596 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.429876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.430150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.430777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:47.432752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:47.463796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1117/2268] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:39:47 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:39:47.466385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.476407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7764-0d3b-4741-b135-65e94759f7a9 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:47.479939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:47.536047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:47.536650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.537011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.537288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.537945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:47.540496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:47.563995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1152/2269] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:39:47 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:39:47.568009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.581378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d345c85-2199-429b-9e9b-b2ce8a0ee04d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:47.586143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:47.586859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.587236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.588313 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.589217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:47.591462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:47.603645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1118/2270] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:39:47.608432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.619230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f03b-6690-469b-9b0e-c15c6aef54ae admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:47.624883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f0e6c-aed1-40cd-afde-5d5b452b350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:47.625507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0e6c-aed1-40cd-afde-5d5b452b350d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.625850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0e6c-aed1-40cd-afde-5d5b452b350d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.626191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f0e6c-aed1-40cd-afde-5d5b452b350d admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.626851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f0e6c-aed1-40cd-afde-5d5b452b350d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:47.628651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f0e6c-aed1-40cd-afde-5d5b452b350d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:47.643628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1153/2271] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:39:47.645934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.658469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aba4d-34b7-4301-a890-49f38d220bee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:47.663375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:47.664097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.664383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.664660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] PATH_INFO: `/v3/projects/d6871ceb173145afad1d020246fa935a/users/72bb387808e247b18ea5e142e23cdb42/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.809908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6871ceb173145afad1d020246fa935a, user_id=72bb387808e247b18ea5e142e23cdb42, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:47.812666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:47.829868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1119/2272] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:39:47 2022] PUT /identity/v3/projects/d6871ceb173145afad1d020246fa935a/users/72bb387808e247b18ea5e142e23cdb42/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:47.841885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:47.842723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:47.843048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:47.875272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] MFA Rules not processed for user `72bb387808e247b18ea5e142e23cdb42`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:47.876727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:47.963730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1154/2273] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:47.982824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:47.985545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:48.055189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd045b01-9d66-4bd3-a50c-7c6ce239baf9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:48.059481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717ade6a084349a8864cf15ce0d827fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:48.060202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:48.060675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:48.061021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:48.071080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:48.073122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:48.084482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1120/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:48.554689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:48.556136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:48.646254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cca6a-b41b-4452-b405-f4f04c3c6d64 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:48.650546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:48.650872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:48.651285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:48.651565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:48.653913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:48.699206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:48.731463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:48.732960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:48.743362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1155/2275] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:49.455192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:49.456818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:49.469863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d4cd1-bf4b-4ddd-a1f6-c81aa64b2e40 service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:49.473730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:49.474325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:49.474605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:49.474877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:49.476645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:49.556639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:49.558252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:49.572872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1121/2276] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:49.767071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:49.775474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d790-c428-471d-a910-fa1b749d2875 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:49.779475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be088e0-a6bc-4c32-bb34-6dde42b3f2d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:49.780345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be088e0-a6bc-4c32-bb34-6dde42b3f2d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:49.780624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be088e0-a6bc-4c32-bb34-6dde42b3f2d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:49.780971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be088e0-a6bc-4c32-bb34-6dde42b3f2d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:49.782805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9be088e0-a6bc-4c32-bb34-6dde42b3f2d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:49.848804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be088e0-a6bc-4c32-bb34-6dde42b3f2d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:49.850246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be088e0-a6bc-4c32-bb34-6dde42b3f2d7 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:49.861125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1156/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:53.514410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:53.515847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:53.525163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:53.584620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ea3e4-f7dd-41ee-ac02-9e46dabf5a50 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:53.589107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:53.589733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:53.590011 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:53.590285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] PATH_INFO: `/v3/users/2968325565b54be59119330907735074` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:53.591421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2968325565b54be59119330907735074)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:53.593368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:53.639711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2968325565b54be59119330907735074'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:53.640363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2968325565b54be59119330907735074'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:53.641036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2968325565b54be59119330907735074'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:53.647830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2968325565b54be59119330907735074'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:53.660919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2968325565b54be59119330907735074'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:53.673508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1122/2278] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:53 2022] DELETE /identity/v3/users/2968325565b54be59119330907735074 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:53.677989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:53.678453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:53.678564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:53.699367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:39:53.701219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:53.766230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1157/2279] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:39:53.778802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:53.778802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:53.844645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319a2f0-8327-4fb7-901c-e85d9e633551 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:53.848381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:53.849172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:53.849510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:53.849855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:53.861038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:53.862694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:53.873660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1123/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:39:54.525639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:54.529583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:54.548061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0acbe-effb-42ad-8d61-ebfd14a06111 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:54.560084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:54.562617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:54.562980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:54.564355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] PATH_INFO: `/v3/projects/b1fbfce635e84f84930b29c1cbf98d7f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:54.565798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1fbfce635e84f84930b29c1cbf98d7f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:54.568096 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:54.633666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fbfce635e84f84930b29c1cbf98d7f', 'request_id': 'req-7c167b42-613e-4c96-b654-b8a5f9e5064b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.640798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fbfce635e84f84930b29c1cbf98d7f', 'request_id': 'req-7c167b42-613e-4c96-b654-b8a5f9e5064b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.645074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:54.651868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fbfce635e84f84930b29c1cbf98d7f', 'request_id': 'req-7c167b42-613e-4c96-b654-b8a5f9e5064b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.668491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] The token cache is being invalidate because project b1fbfce635e84f84930b29c1cbf98d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:54.668814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.669872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.671831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1158/2281] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:54 2022] DELETE /identity/v3/projects/b1fbfce635e84f84930b29c1cbf98d7f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:54.675875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:54.700258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d223f7-caa2-4d04-b215-3bd49f90a7f9 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:54.733998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:54.774022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:54.774653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:54.774935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:54.775218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] PATH_INFO: `/v3/users/35578019fe9347dd9ac9aa26e69bc335` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:54.776369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35578019fe9347dd9ac9aa26e69bc335)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:54.778333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:54.826257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35578019fe9347dd9ac9aa26e69bc335'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.826897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35578019fe9347dd9ac9aa26e69bc335'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.827987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35578019fe9347dd9ac9aa26e69bc335'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.835060 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35578019fe9347dd9ac9aa26e69bc335'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.847658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35578019fe9347dd9ac9aa26e69bc335'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:54.859822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1124/2282] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:54 2022] DELETE /identity/v3/users/35578019fe9347dd9ac9aa26e69bc335 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:39:55.179055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:55.180556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:55.215473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c167b42-613e-4c96-b654-b8a5f9e5064b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:55.290164 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:55.291208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:55.291581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:55.291802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] PATH_INFO: `/v3/projects/f204b12984294e89802a9908bf416984` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:55.293043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f204b12984294e89802a9908bf416984)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:55.295101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:55.354626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f204b12984294e89802a9908bf416984', 'request_id': 'req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.362458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f204b12984294e89802a9908bf416984', 'request_id': 'req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.369569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f204b12984294e89802a9908bf416984', 'request_id': 'req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.385031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] The token cache is being invalidate because project f204b12984294e89802a9908bf416984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:55.385327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.385971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.390261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1159/2283] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:55 2022] DELETE /identity/v3/projects/f204b12984294e89802a9908bf416984 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:55.394657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:55.396255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:55.409348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001621c4-a61e-438d-896b-22c9ca5c2f92 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:55.469192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:55.469898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:55.470271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:55.470624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] PATH_INFO: `/v3/users/bf34edcb050841798fd41bd8dcbfda51` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:55.471823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf34edcb050841798fd41bd8dcbfda51)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:55.474108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:55.530776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf34edcb050841798fd41bd8dcbfda51'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.531411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf34edcb050841798fd41bd8dcbfda51'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.532058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf34edcb050841798fd41bd8dcbfda51'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.534070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:55.542063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf34edcb050841798fd41bd8dcbfda51'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.562998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a38d6b18-6ae6-4bd8-8674-356236d6f0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf34edcb050841798fd41bd8dcbfda51'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:55.578864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1125/2284] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:39:55 2022] DELETE /identity/v3/users/bf34edcb050841798fd41bd8dcbfda51 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:39:56.008896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:39:56.010399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:39:56.024556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7ccf-8a21-4f54-8ddf-972d1dd29195 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:39:56.094560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:39:56.095363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:39:56.095684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:39:56.095967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] PATH_INFO: `/v3/projects/9bb1c601c41a44668580474841d39c11` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:39:56.097323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb1c601c41a44668580474841d39c11)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:39:56.099384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:39:56.122009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:39:56.151408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb1c601c41a44668580474841d39c11', 'request_id': 'req-cb48c819-1b0e-411f-91d7-18777df4b342'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:56.157713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb1c601c41a44668580474841d39c11', 'request_id': 'req-cb48c819-1b0e-411f-91d7-18777df4b342'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:56.164417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb1c601c41a44668580474841d39c11', 'request_id': 'req-cb48c819-1b0e-411f-91d7-18777df4b342'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:56.177941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] The token cache is being invalidate because project 9bb1c601c41a44668580474841d39c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:39:56.178232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:56.178863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:39:56.180387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1160/2285] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:39:56 2022] DELETE /identity/v3/projects/9bb1c601c41a44668580474841d39c11 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:02.001611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d452-ae7f-4ec3-adcb-1e8101da72e5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:02.002043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d452-ae7f-4ec3-adcb-1e8101da72e5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:02.002147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9d452-ae7f-4ec3-adcb-1e8101da72e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:02.027939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-acc9d452-ae7f-4ec3-adcb-1e8101da72e5 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:02.030141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-acc9d452-ae7f-4ec3-adcb-1e8101da72e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:02.119499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1126/2286] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:40:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:02.174759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:02.176779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:02.266198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48c819-1b0e-411f-91d7-18777df4b342 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:02.272203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:02.272899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:02.273253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:02.273607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:02.285031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:02.286930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:02.296501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1161/2287] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:40:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:40:02.829159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82b034-5eea-4e36-a452-7569b51dd10a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:02.829445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82b034-5eea-4e36-a452-7569b51dd10a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:02.829722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82b034-5eea-4e36-a452-7569b51dd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:02.849699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fb82b034-5eea-4e36-a452-7569b51dd10a None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:02.850823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb82b034-5eea-4e36-a452-7569b51dd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:02.858717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1127/2288] 10.222.0.16 () {58 vars in 967 bytes} [Mon Sep 5 10:40:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:02.872027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:02.883101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0aa85-5f53-49b7-ae88-1a7ef0347f7e service swift] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:02.888412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:02.888931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:02.889242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:02.889523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:02.897498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:02.899082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:02.907896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1162/2289] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:40:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:40:03.171676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6becc-7bfe-4e78-996a-9f1922958602 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:03.172146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6becc-7bfe-4e78-996a-9f1922958602 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:03.172252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6becc-7bfe-4e78-996a-9f1922958602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:03.192605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d7c6becc-7bfe-4e78-996a-9f1922958602 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:03.193838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7c6becc-7bfe-4e78-996a-9f1922958602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:03.201249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1128/2290] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:40:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:03.213846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:03.225797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cb4d9-af97-4f3c-bda1-2b8c0dedf483 service swift] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:03.231039 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:03.232328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:03.232824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:03.233342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:03.242172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:03.243803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:03.253518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1163/2291] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 10:40:03.765362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:03.765653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:03.765929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:03.785388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:03.786640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:03.793768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1129/2292] 10.222.0.16 () {58 vars in 967 bytes} [Mon Sep 5 10:40:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:03.805993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:03.816407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3c158-b370-4071-badb-070d0780d122 service swift] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:03.821465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d35d-2fae-490b-8b25-3caeec84fe1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:03.822059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d35d-2fae-490b-8b25-3caeec84fe1f service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:03.822338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d35d-2fae-490b-8b25-3caeec84fe1f service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:03.822611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d35d-2fae-490b-8b25-3caeec84fe1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:03.831871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d35d-2fae-490b-8b25-3caeec84fe1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:03.833460 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d35d-2fae-490b-8b25-3caeec84fe1f service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:03.842482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1164/2293] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:40:05.965961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:05.967355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:06.035829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6875ac-5495-4f5e-8114-4d250888bb3b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:06.041016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:06.041641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.041907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.042180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] PATH_INFO: `/v3/users/144af1ca8c294285a54b5378ee7a08f9` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.043297 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144af1ca8c294285a54b5378ee7a08f9)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:06.045802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:06.095077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144af1ca8c294285a54b5378ee7a08f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.095835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144af1ca8c294285a54b5378ee7a08f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.096476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144af1ca8c294285a54b5378ee7a08f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.102436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:06.104788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144af1ca8c294285a54b5378ee7a08f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.122829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144af1ca8c294285a54b5378ee7a08f9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.138015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1130/2294] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:05 2022] DELETE /identity/v3/users/144af1ca8c294285a54b5378ee7a08f9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:06.142664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.143107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.143258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.163414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:06.164649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:06.250534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:06.272176 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1165/2295] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:06.286151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:06.287806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:06.349457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531f541-d13c-4055-8276-479fadf416a2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:06.352970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d3e03-ae1c-4779-92b7-e964c3899d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:06.353574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3e03-ae1c-4779-92b7-e964c3899d22 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.353854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3e03-ae1c-4779-92b7-e964c3899d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.354116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3e03-ae1c-4779-92b7-e964c3899d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.364399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3e03-ae1c-4779-92b7-e964c3899d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:06.365860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3e03-ae1c-4779-92b7-e964c3899d22 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:06.375681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1131/2296] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:06.544011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:06.545522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:06.557800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d6194-00d0-4899-b3bd-f6e5513f6fa1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:06.564227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:06.564871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.565151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.565423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] PATH_INFO: `/v3/projects/599ec2434436448f8446347434ca662c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.566549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=599ec2434436448f8446347434ca662c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:06.568529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:06.616659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599ec2434436448f8446347434ca662c', 'request_id': 'req-0d95445c-27ce-47b1-b384-b4543e3ba9aa'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.622950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599ec2434436448f8446347434ca662c', 'request_id': 'req-0d95445c-27ce-47b1-b384-b4543e3ba9aa'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.629284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599ec2434436448f8446347434ca662c', 'request_id': 'req-0d95445c-27ce-47b1-b384-b4543e3ba9aa'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.644438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] The token cache is being invalidate because project 599ec2434436448f8446347434ca662c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:06.644727 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.645383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d95445c-27ce-47b1-b384-b4543e3ba9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:06.646862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1166/2297] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:06 2022] DELETE /identity/v3/projects/599ec2434436448f8446347434ca662c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:06.651834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216da3-65ef-48b1-a900-1f7cd2d50e61 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.652119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216da3-65ef-48b1-a900-1f7cd2d50e61 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.652393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2216da3-65ef-48b1-a900-1f7cd2d50e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.672228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e2216da3-65ef-48b1-a900-1f7cd2d50e61 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:06.673456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e2216da3-65ef-48b1-a900-1f7cd2d50e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:06.741029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1132/2298] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:06.749943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9307e-28b0-4dcf-8936-51b9a3e22ed5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.750257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9307e-28b0-4dcf-8936-51b9a3e22ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.750531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9307e-28b0-4dcf-8936-51b9a3e22ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.771444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-59d9307e-28b0-4dcf-8936-51b9a3e22ed5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:06.772710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-59d9307e-28b0-4dcf-8936-51b9a3e22ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:06.781204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1167/2299] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:06.785494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2216da3-65ef-48b1-a900-1f7cd2d50e61 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:06.795932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2216da3-65ef-48b1-a900-1f7cd2d50e61 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:06.800496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:06.801106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.801391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.801678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.802325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:40:06.802629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:06.804270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:06.816490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1133/2300] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:40:06.820685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9307e-28b0-4dcf-8936-51b9a3e22ed5 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:06.830893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9307e-28b0-4dcf-8936-51b9a3e22ed5 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:06.835565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:06.836187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.836522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.836794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.837547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:06.839427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:06.866517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1168/2301] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:06 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:06.870641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:06.881130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc143e-3017-448f-b8d0-70bc7a31007b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:06.938977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:06.939609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.939897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.940172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.940812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:06.942718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:06.952492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:06.968756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1134/2302] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:06 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:06.972623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:06.985083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188034-8eb6-48ef-9fc1-0e8e46603241 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:06.990125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:06.990785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:06.991058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:06.991329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:06.992100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:06.993709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:07.005020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1169/2303] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:07.008911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:07.020781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9eff4-949d-432c-8c63-7b13a2a7245c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:07.025654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41608a10-677e-4107-86d3-a64257d7c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:07.026283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41608a10-677e-4107-86d3-a64257d7c606 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:07.026549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41608a10-677e-4107-86d3-a64257d7c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:07.026825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41608a10-677e-4107-86d3-a64257d7c606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:07.027472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41608a10-677e-4107-86d3-a64257d7c606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:07.029847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41608a10-677e-4107-86d3-a64257d7c606 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:07.040829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1135/2304] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:07.045497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:07.055533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb364-35ab-48f0-b179-07e0eb6af835 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:07.061736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:07.062397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:07.062678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:07.062955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] PATH_INFO: `/v3/projects/7c2c32d8b6ef48359f588ef485949bf1/users/c79b2adcfb2742368169681653cdc7f9/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:07.078105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2c32d8b6ef48359f588ef485949bf1, user_id=c79b2adcfb2742368169681653cdc7f9, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:07.081000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:07.104998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1170/2305] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:07 2022] PUT /identity/v3/projects/7c2c32d8b6ef48359f588ef485949bf1/users/c79b2adcfb2742368169681653cdc7f9/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:40:07.110703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2060e9-b3e7-4755-b37d-dcec59b368a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:07.110990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2060e9-b3e7-4755-b37d-dcec59b368a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:07.111265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2060e9-b3e7-4755-b37d-dcec59b368a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:07.132129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4c2060e9-b3e7-4755-b37d-dcec59b368a2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:07.133335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4c2060e9-b3e7-4755-b37d-dcec59b368a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:07.191146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1136/2306] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:07.201076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:07.202825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:07.267947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029edba-28e0-4745-9d7f-fd73ffcdf17b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:07.271568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:07.272203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:07.272481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:07.272755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:07.282387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:07.283849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:07.293824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1171/2307] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:12.549198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb172-8223-41a6-b55a-b73908efe880 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:12.549759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb172-8223-41a6-b55a-b73908efe880 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:12.549759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb172-8223-41a6-b55a-b73908efe880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:12.585483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e10eb172-8223-41a6-b55a-b73908efe880 None None] MFA Rules not processed for user `c79b2adcfb2742368169681653cdc7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:12.586742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e10eb172-8223-41a6-b55a-b73908efe880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:12.675024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1137/2308] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:12.679097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:12.691210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c346569-626b-4349-a11d-c793d9807286 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:12.697163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:12.698049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:12.698527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:12.698996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:12.700500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:12.703152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:12.729920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:12.744464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1172/2309] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:12 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:12.749582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb172-8223-41a6-b55a-b73908efe880 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:12.763467 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb172-8223-41a6-b55a-b73908efe880 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:12.823831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:12.824544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:12.825478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:12.825855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:12.826594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:12.828710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:12.852697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:12.863781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1138/2310] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:12 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:40:12.865074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:12.880913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3c85-7eb7-4cb2-a451-ee1252cbc71d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:12.885846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:12.886452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:12.887048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:12.887885 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:12.888545 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:12.890186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:12.902585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1173/2311] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:40:12.907510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:12.918408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271673-20c1-43ce-9dcc-529f8cb887a9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:12.924306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:12.924983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:12.925267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:12.925546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] PATH_INFO: `/v3/projects/eadb590f51d74b52aee3019ab44e058f/users/cc2489808b4a4a3993c1191117700c75/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:12.944392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb590f51d74b52aee3019ab44e058f, user_id=cc2489808b4a4a3993c1191117700c75, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:12.947209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:12.976308 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1139/2312] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:12 2022] PUT /identity/v3/projects/eadb590f51d74b52aee3019ab44e058f/users/cc2489808b4a4a3993c1191117700c75/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:12.979913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:12.994861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e1b8-199e-4ea2-aedb-d7b114b1919e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:13.087314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0b3f-4a60-4cc7-9017-e4ed8816b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:13.088112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0b3f-4a60-4cc7-9017-e4ed8816b0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:13.088621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0b3f-4a60-4cc7-9017-e4ed8816b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:13.089295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0b3f-4a60-4cc7-9017-e4ed8816b0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:13.090330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0b3f-4a60-4cc7-9017-e4ed8816b0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:13.094801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0b3f-4a60-4cc7-9017-e4ed8816b0b7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:13.109772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1174/2313] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:13.113807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:13.125775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79d92e-20b6-4a62-9837-bc75faf5ac66 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:13.131704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d52d38-29d1-437d-9c87-a28b375bba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:13.132372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d52d38-29d1-437d-9c87-a28b375bba6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:13.132655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d52d38-29d1-437d-9c87-a28b375bba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:13.132928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d52d38-29d1-437d-9c87-a28b375bba6e admin admin] PATH_INFO: `/v3/projects/eadb590f51d74b52aee3019ab44e058f/users/cc2489808b4a4a3993c1191117700c75/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:13.134848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d52d38-29d1-437d-9c87-a28b375bba6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb590f51d74b52aee3019ab44e058f, user_id=cc2489808b4a4a3993c1191117700c75, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:13.138273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d52d38-29d1-437d-9c87-a28b375bba6e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:13.150651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1140/2314] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:13 2022] PUT /identity/v3/projects/eadb590f51d74b52aee3019ab44e058f/users/cc2489808b4a4a3993c1191117700c75/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:14.469143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448f24-77ea-4528-8806-08e5a71d2526 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:14.470067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448f24-77ea-4528-8806-08e5a71d2526 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:14.470496 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6448f24-77ea-4528-8806-08e5a71d2526 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:14.472779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1175/2315] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:40:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:40:14.495054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c04e4f-9735-474b-a487-f8c219a7f2f1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:14.495966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c04e4f-9735-474b-a487-f8c219a7f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:14.496430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c04e4f-9735-474b-a487-f8c219a7f2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:14.539811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-30c04e4f-9735-474b-a487-f8c219a7f2f1 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:14.541537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-30c04e4f-9735-474b-a487-f8c219a7f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:14.739876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1141/2316] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:14.770031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e302-5068-4b7a-9e5f-4b1e5f555185 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:14.770712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e302-5068-4b7a-9e5f-4b1e5f555185 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:14.771201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e302-5068-4b7a-9e5f-4b1e5f555185 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:14.772939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1176/2317] 10.222.0.16 () {54 vars in 961 bytes} [Mon Sep 5 10:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:40:14.780480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:14.781119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:14.781445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:14.854941 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] MFA Rules not processed for user `9f1f8f4eb1c444edb1c197db41cd6f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:14.856948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:14.879840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1142/2318] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Sep 5 10:40:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:14.889353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e302-5068-4b7a-9e5f-4b1e5f555185 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:14.916703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e302-5068-4b7a-9e5f-4b1e5f555185 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:14.929527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:14.932158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:14.932450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:14.932735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:14.958976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:14.964945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:14.995840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1177/2319] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:15.564777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:15.567000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:15.676654 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099569-2b7b-4b6b-b0a6-211bf6e175f4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:15.681719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:15.682374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:15.682693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:15.682935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] PATH_INFO: `/v3/users/9bc12cf52ac847a7bfeac95ca2e2f2f3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:15.684342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc12cf52ac847a7bfeac95ca2e2f2f3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:15.686410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:15.826498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc12cf52ac847a7bfeac95ca2e2f2f3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:15.829455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc12cf52ac847a7bfeac95ca2e2f2f3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:15.830077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc12cf52ac847a7bfeac95ca2e2f2f3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:15.858496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:15.864071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc12cf52ac847a7bfeac95ca2e2f2f3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:15.883551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc12cf52ac847a7bfeac95ca2e2f2f3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:15.913981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1143/2320] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:15 2022] DELETE /identity/v3/users/9bc12cf52ac847a7bfeac95ca2e2f2f3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:16.198910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:16.211450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d41597-b0c0-43db-abdc-af5008ff8dcd service placement] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:16.298360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:16.299105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:16.299395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:16.299711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] PATH_INFO: `/v3/projects/1e132c779505494f979aa8e8769561ea` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:16.300924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e132c779505494f979aa8e8769561ea)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:16.302912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:16.378351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e132c779505494f979aa8e8769561ea', 'request_id': 'req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.386856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e132c779505494f979aa8e8769561ea', 'request_id': 'req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.396855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e132c779505494f979aa8e8769561ea', 'request_id': 'req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.413355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:16.424491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] The token cache is being invalidate because project 1e132c779505494f979aa8e8769561ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:16.425109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.426874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.429187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1178/2321] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:16 2022] DELETE /identity/v3/projects/1e132c779505494f979aa8e8769561ea => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:16.433802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:16.440178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:16.462383 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c7c54-8fa1-4dde-b5d9-8a0b6daf2bbd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:16.634683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:16.635329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:16.635674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:16.635958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] PATH_INFO: `/v3/users/d6a5f8a4cf464feaa0254abc75f2a6be` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:16.639394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a5f8a4cf464feaa0254abc75f2a6be)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:16.641421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:16.730702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a5f8a4cf464feaa0254abc75f2a6be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.732896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a5f8a4cf464feaa0254abc75f2a6be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.733776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a5f8a4cf464feaa0254abc75f2a6be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.754226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a5f8a4cf464feaa0254abc75f2a6be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.773049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a5f8a4cf464feaa0254abc75f2a6be'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:16.808944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1144/2322] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:16 2022] DELETE /identity/v3/users/d6a5f8a4cf464feaa0254abc75f2a6be => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:17.017473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:17.019474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:17.041564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc3b4b-2ab3-4f74-930c-8674f24d19b8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:17.208447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:17.210149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:17.217453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:17.218020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.218020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.218218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] PATH_INFO: `/v3/users/72bb387808e247b18ea5e142e23cdb42` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.219899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72bb387808e247b18ea5e142e23cdb42)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:17.222075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:17.329776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72bb387808e247b18ea5e142e23cdb42'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.332093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72bb387808e247b18ea5e142e23cdb42'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.338953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:17.365687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72bb387808e247b18ea5e142e23cdb42'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.367709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c83fc9-52a7-4674-ba81-9c4b1ecff568 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:17.380499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:17.381109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.381390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.381659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] PATH_INFO: `/v3/projects/13fcd89cfdd2440fa472c81ecc57b07c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.382297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72bb387808e247b18ea5e142e23cdb42'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.383620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e29350e1-bdc8-45be-b667-50c732b7aa7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72bb387808e247b18ea5e142e23cdb42'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.385109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fcd89cfdd2440fa472c81ecc57b07c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:17.389947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:17.405677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1179/2323] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:17 2022] DELETE /identity/v3/users/72bb387808e247b18ea5e142e23cdb42 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:17.412020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.412447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.412824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.469244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:17.471544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:17.474007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fcd89cfdd2440fa472c81ecc57b07c', 'request_id': 'req-881b41d2-2fe2-41af-bdac-c7fd106681f6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.485482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fcd89cfdd2440fa472c81ecc57b07c', 'request_id': 'req-881b41d2-2fe2-41af-bdac-c7fd106681f6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.495320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fcd89cfdd2440fa472c81ecc57b07c', 'request_id': 'req-881b41d2-2fe2-41af-bdac-c7fd106681f6'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.516820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] The token cache is being invalidate because project 13fcd89cfdd2440fa472c81ecc57b07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:17.517271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.519193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-881b41d2-2fe2-41af-bdac-c7fd106681f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:17.525706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1145/2324] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:17 2022] DELETE /identity/v3/projects/13fcd89cfdd2440fa472c81ecc57b07c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:17.531500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bfb03-8817-4633-9dc5-e82be9d8bcd1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.533439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bfb03-8817-4633-9dc5-e82be9d8bcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.533826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bfb03-8817-4633-9dc5-e82be9d8bcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.561890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-242bfb03-8817-4633-9dc5-e82be9d8bcd1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:17.564340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-242bfb03-8817-4633-9dc5-e82be9d8bcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:17.708973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1146/2325] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:17.711708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1180/2326] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:17.719827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cb96c-41a7-427d-9121-d252098baa92 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.719827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cb96c-41a7-427d-9121-d252098baa92 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.719827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cb96c-41a7-427d-9121-d252098baa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.729276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:17.731195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:17.756256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-340cb96c-41a7-427d-9121-d252098baa92 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:17.757488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-340cb96c-41a7-427d-9121-d252098baa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:17.783559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:17.787222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1147/2327] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:17.788038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cb96c-41a7-427d-9121-d252098baa92 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:17.804898 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cb96c-41a7-427d-9121-d252098baa92 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:17.816291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:17.817412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.817857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.818284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.819968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:40:17.821341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:17.825986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:17.860167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1148/2328] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:40:17.862416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:17.873726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf2355-610c-427d-bcd1-0610c49f2406 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:17.877998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:17.878655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.878939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.879224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.892329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:17.894150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:17.900526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f5447-27da-443b-b365-b5035959a5ee admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:17.908309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1181/2329] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:40:17.914058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78755f9f-88f1-411c-b4b9-fb7601a5017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:17.915176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755f9f-88f1-411c-b4b9-fb7601a5017f admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:17.932005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755f9f-88f1-411c-b4b9-fb7601a5017f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:17.938547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78755f9f-88f1-411c-b4b9-fb7601a5017f admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:17.940174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755f9f-88f1-411c-b4b9-fb7601a5017f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:17.943303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78755f9f-88f1-411c-b4b9-fb7601a5017f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:18.034848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1149/2330] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:17 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:18.035701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:18.054526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56562c90-1f08-49e9-8c35-6f354caf61b0 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:18.113327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:18.113327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:18.113327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:18.145202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:18.146479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:18.201627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:18.202246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:18.202528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:18.202801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:18.203444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:18.205453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:18.233798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:18.263512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1182/2331] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:18 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:18.268330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:18.295754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1150/2332] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:40:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:18.297291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e3d12-f3fe-439b-977a-5c70fdbd185e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:18.311491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:18.311712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:18.312218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:18.312498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:18.312786 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:18.313455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:18.314128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:18.317479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:18.344799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1183/2333] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:40:18.349365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:18.376593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc9f08-f261-49c6-9899-17ed0c7ce416 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:18.389636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:18.390266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:18.390554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:18.399419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:18.400179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:18.401840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:18.421522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1184/2334] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:18.425342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95577b-b1b5-4597-b844-0251ff140c18 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:18.426414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:18.429512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67411332-8f60-44f8-856f-34f59df159e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:18.430265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67411332-8f60-44f8-856f-34f59df159e1 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:18.430610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67411332-8f60-44f8-856f-34f59df159e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:18.431527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67411332-8f60-44f8-856f-34f59df159e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:18.441453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed10ab-30fb-4325-84c3-933f2989cda0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:18.444977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67411332-8f60-44f8-856f-34f59df159e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:18.447432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67411332-8f60-44f8-856f-34f59df159e1 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:18.447752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:18.448432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:18.448700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:18.448980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] PATH_INFO: `/v3/projects/3801293a6f964a7f97073809f471d354/users/48681f1e46be498ba032c8b11d5ebbf7/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:18.487417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3801293a6f964a7f97073809f471d354, user_id=48681f1e46be498ba032c8b11d5ebbf7, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:18.490408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:18.499874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1151/2335] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:40:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:40:18.515120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1185/2336] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:18 2022] PUT /identity/v3/projects/3801293a6f964a7f97073809f471d354/users/48681f1e46be498ba032c8b11d5ebbf7/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:18.532024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:18.532792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:18.533369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:18.595159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] MFA Rules not processed for user `48681f1e46be498ba032c8b11d5ebbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:18.598765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:18.803342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1152/2337] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:18.816493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:18.829246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:19.023323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494498-4614-47a3-997d-b8d374d00e5b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:19.039470 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b78a5-d2b0-4c7e-9963-fab2e4db00e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:19.040194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b78a5-d2b0-4c7e-9963-fab2e4db00e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:19.040743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b78a5-d2b0-4c7e-9963-fab2e4db00e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:19.041010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b78a5-d2b0-4c7e-9963-fab2e4db00e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:19.057131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b78a5-d2b0-4c7e-9963-fab2e4db00e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:19.063094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b78a5-d2b0-4c7e-9963-fab2e4db00e1 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:19.097746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1186/2338] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:19.167460 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:19.170777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:19.440540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f53930-2ad4-4e90-ac47-53d67e09b984 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:19.461118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:19.461118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:19.461462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:19.461805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] PATH_INFO: `/v3/projects/d6871ceb173145afad1d020246fa935a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:19.462907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6871ceb173145afad1d020246fa935a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:19.473098 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:19.483082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:19.585315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6871ceb173145afad1d020246fa935a', 'request_id': 'req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:19.600796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6871ceb173145afad1d020246fa935a', 'request_id': 'req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:19.632217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6871ceb173145afad1d020246fa935a', 'request_id': 'req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:19.651251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] The token cache is being invalidate because project d6871ceb173145afad1d020246fa935a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:19.651930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:19.653381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8d0ffbee-7111-4b1a-87cf-dfa139e7e343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:19.657866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1153/2339] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:19 2022] DELETE /identity/v3/projects/d6871ceb173145afad1d020246fa935a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:19.662776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d49c94-b93f-41ec-abcf-0ba4f83143ea None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:19.663297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d49c94-b93f-41ec-abcf-0ba4f83143ea None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:19.663505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d49c94-b93f-41ec-abcf-0ba4f83143ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:19.705854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-25d49c94-b93f-41ec-abcf-0ba4f83143ea None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:19.719054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-25d49c94-b93f-41ec-abcf-0ba4f83143ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:19.740578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:19.878130 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1187/2340] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:19.896943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e630d60-863f-45a6-a748-8d09ce53f753 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:19.897871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e630d60-863f-45a6-a748-8d09ce53f753 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:19.898301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e630d60-863f-45a6-a748-8d09ce53f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:19.920382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e630d60-863f-45a6-a748-8d09ce53f753 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:19.921859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e630d60-863f-45a6-a748-8d09ce53f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:19.932271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1154/2341] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:19.936753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d49c94-b93f-41ec-abcf-0ba4f83143ea None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:19.952985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d49c94-b93f-41ec-abcf-0ba4f83143ea None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:19.964194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:19.965563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:19.966020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:19.966443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:19.967256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:40:19.967736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:19.969529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:19.994975 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1188/2342] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:40:19.999479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e630d60-863f-45a6-a748-8d09ce53f753 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:20.009953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e630d60-863f-45a6-a748-8d09ce53f753 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:20.023642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:20.026680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:20.027072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:20.027450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:20.031956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:20.034077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:20.130410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1155/2343] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:19 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:20.135432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:20.158695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d16dcb-8adf-44bb-87ea-5c8a1c4c0c5c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:20.290312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:20.290948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:20.291233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:20.291510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:20.292183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:20.294187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:20.344636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1189/2344] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:20 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:20.345806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:20.358408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67080-2ef2-4462-a567-bae5b4607163 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:20.383354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:20.384094 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:20.384384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:20.384658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:20.385328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:20.387130 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:20.407976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1156/2345] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:20.411569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:20.423144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa9625-8d14-45ea-a9c4-f5cc21e67e23 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:20.439543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e664-49b5-471e-8b9c-e3f55edfe89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:20.444213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e664-49b5-471e-8b9c-e3f55edfe89b admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:20.444577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e664-49b5-471e-8b9c-e3f55edfe89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:20.444841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e664-49b5-471e-8b9c-e3f55edfe89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:20.445555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e664-49b5-471e-8b9c-e3f55edfe89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:20.447230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e664-49b5-471e-8b9c-e3f55edfe89b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:20.480498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1190/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:20.482955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:20.500995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93afbe2-7d09-4c42-9e67-a87cdf31edc9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:20.508059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:20.508917 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:20.509295 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:20.509664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] PATH_INFO: `/v3/projects/4dc60ac319384f30a8b8dcfa38d6f6a8/users/ad3e51391bfa495b94928c116fee715f/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:20.539052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc60ac319384f30a8b8dcfa38d6f6a8, user_id=ad3e51391bfa495b94928c116fee715f, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:20.542087 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:20.579509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1157/2347] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:20 2022] PUT /identity/v3/projects/4dc60ac319384f30a8b8dcfa38d6f6a8/users/ad3e51391bfa495b94928c116fee715f/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:20.581932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8823a7-a9fa-4e08-a4d4-7344513594bc None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:20.582417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8823a7-a9fa-4e08-a4d4-7344513594bc None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:20.582848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8823a7-a9fa-4e08-a4d4-7344513594bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:20.637073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-9b8823a7-a9fa-4e08-a4d4-7344513594bc None None] MFA Rules not processed for user `ad3e51391bfa495b94928c116fee715f`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:20.641945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9b8823a7-a9fa-4e08-a4d4-7344513594bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:20.794973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1191/2348] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:20.808034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:20.811693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:20.987364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ef575-ed76-48a8-9cee-53ed9f6e1b13 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:20.997635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:20.998582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:20.999051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:20.999481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:21.015877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:21.017647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:21.043876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1158/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:22.196948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf1bab-7af2-469c-b86d-0f9b4a21e9a1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:22.197548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf1bab-7af2-469c-b86d-0f9b4a21e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:22.197548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf1bab-7af2-469c-b86d-0f9b4a21e9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:22.221774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:22.266042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-8baf1bab-7af2-469c-b86d-0f9b4a21e9a1 None None] MFA Rules not processed for user `cc2489808b4a4a3993c1191117700c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:22.267556 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8baf1bab-7af2-469c-b86d-0f9b4a21e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:22.432982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1192/2350] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:22.448022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:22.450914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:22.519359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:22.607980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da622bd-3130-454c-9dbc-ec8908c88858 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:22.616758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:22.617619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:22.618073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:22.618500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:22.620823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:22.707666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:22.709490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:22.728857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1159/2351] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:40:24.722482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49c45-b40d-420b-be74-dc3a290fd209 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:24.723106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49c45-b40d-420b-be74-dc3a290fd209 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:24.723106 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49c45-b40d-420b-be74-dc3a290fd209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:24.762748 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f1d49c45-b40d-420b-be74-dc3a290fd209 None None] MFA Rules not processed for user `c79b2adcfb2742368169681653cdc7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:24.764084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f1d49c45-b40d-420b-be74-dc3a290fd209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:24.771349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1193/2352] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:26.000601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:26.002524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:26.087965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f015069-fd97-4132-97ca-c6fb219cefa6 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:26.093529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:26.094466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:26.094824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:26.095189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] PATH_INFO: `/v3/users/48681f1e46be498ba032c8b11d5ebbf7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:26.096573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48681f1e46be498ba032c8b11d5ebbf7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:26.098519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:26.164402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48681f1e46be498ba032c8b11d5ebbf7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:26.165369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48681f1e46be498ba032c8b11d5ebbf7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:26.166316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48681f1e46be498ba032c8b11d5ebbf7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:26.175624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48681f1e46be498ba032c8b11d5ebbf7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:26.211775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:26.216810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48681f1e46be498ba032c8b11d5ebbf7'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:26.238622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1160/2353] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:25 2022] DELETE /identity/v3/users/48681f1e46be498ba032c8b11d5ebbf7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:26.240342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:26.240846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:26.240846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:26.284015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:26.287714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:26.397230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1194/2354] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:26.403777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:26.409909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:26.503198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299be0d0-54dd-49d6-bff1-2426dedb1b9f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:26.507741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf7f60-975a-4542-9347-3e1bbfbaf3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:26.508477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7f60-975a-4542-9347-3e1bbfbaf3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:26.508863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7f60-975a-4542-9347-3e1bbfbaf3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:26.509267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7f60-975a-4542-9347-3e1bbfbaf3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:26.521041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf7f60-975a-4542-9347-3e1bbfbaf3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:26.534493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf7f60-975a-4542-9347-3e1bbfbaf3d7 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:26.547259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1161/2355] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:26.986461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:26.988972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:27.006365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26514799-366b-4083-8093-f4ec9b6dcc51 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:27.013575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:27.014546 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:27.015056 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:27.015862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] PATH_INFO: `/v3/projects/3801293a6f964a7f97073809f471d354` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:27.017347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3801293a6f964a7f97073809f471d354)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:27.019535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:27.095801 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3801293a6f964a7f97073809f471d354', 'request_id': 'req-c31f52b4-7f66-452f-8264-65c20e3ed52e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:27.102845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3801293a6f964a7f97073809f471d354', 'request_id': 'req-c31f52b4-7f66-452f-8264-65c20e3ed52e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:27.110693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3801293a6f964a7f97073809f471d354', 'request_id': 'req-c31f52b4-7f66-452f-8264-65c20e3ed52e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:27.147002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] The token cache is being invalidate because project 3801293a6f964a7f97073809f471d354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:27.147115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:27.147857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c31f52b4-7f66-452f-8264-65c20e3ed52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:27.149639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1195/2356] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:26 2022] DELETE /identity/v3/projects/3801293a6f964a7f97073809f471d354 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:27.154779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50a08f-87f1-4844-94a3-33c734c757da None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:27.155258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50a08f-87f1-4844-94a3-33c734c757da None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:27.155353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50a08f-87f1-4844-94a3-33c734c757da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:27.215502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cf50a08f-87f1-4844-94a3-33c734c757da None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:27.216995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf50a08f-87f1-4844-94a3-33c734c757da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:27.425594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1162/2357] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:27.427233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc8cd-b27e-47a6-82a1-ffc48ccd3272 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:27.427743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc8cd-b27e-47a6-82a1-ffc48ccd3272 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:27.427837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc8cd-b27e-47a6-82a1-ffc48ccd3272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:27.456534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:27.476679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-41fbc8cd-b27e-47a6-82a1-ffc48ccd3272 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:27.480367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-41fbc8cd-b27e-47a6-82a1-ffc48ccd3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:27.499819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50a08f-87f1-4844-94a3-33c734c757da None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:27.506516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1196/2358] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:27.511232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50a08f-87f1-4844-94a3-33c734c757da None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:27.516983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:27.518162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:27.518929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:27.519394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:27.520280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:40:27.520758 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:27.522666 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:27.557353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbc8cd-b27e-47a6-82a1-ffc48ccd3272 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:27.564401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1163/2359] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:40:27.568463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbc8cd-b27e-47a6-82a1-ffc48ccd3272 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:27.576669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:27.578095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:27.578576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:27.579086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:27.580121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:27.583994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:27.652226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1197/2360] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:27 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:27.656967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:27.690502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b444c-086d-4cd2-a4ce-8f3bac77fd3c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:27.869779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:27.870462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:27.870817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:27.871255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:27.872364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:27.874439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:27.950921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1164/2361] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:27 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:27.951747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:27.969215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f34c2d-078a-477d-8e1d-deeb6e5a21d7 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:27.974615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:27.975233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:27.975533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:27.975847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:27.976522 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:27.978147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:27.997306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1198/2362] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:40:27.998678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:28.015132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb725-4650-42f8-b736-96ab124998ae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:28.029494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caab2b-ac61-4362-a2c6-1f9c7b55b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:28.030264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caab2b-ac61-4362-a2c6-1f9c7b55b902 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:28.030556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caab2b-ac61-4362-a2c6-1f9c7b55b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:28.030831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caab2b-ac61-4362-a2c6-1f9c7b55b902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:28.031493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caab2b-ac61-4362-a2c6-1f9c7b55b902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:28.033473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caab2b-ac61-4362-a2c6-1f9c7b55b902 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:28.038573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:28.053641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1165/2363] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:40:28.057066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:28.077671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e8d54-60d2-4f31-b5c8-a787df83cdc1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:28.094179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:28.096883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:28.097838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:28.098230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] PATH_INFO: `/v3/projects/1e78c5f3d16e46e38c6a3280658d3f64/users/6c3f554c019a4907b55a6f779ff99631/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:28.125531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e78c5f3d16e46e38c6a3280658d3f64, user_id=6c3f554c019a4907b55a6f779ff99631, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:28.128828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:28.159398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1199/2364] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:28 2022] PUT /identity/v3/projects/1e78c5f3d16e46e38c6a3280658d3f64/users/6c3f554c019a4907b55a6f779ff99631/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:28.161210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126aaa-46b0-4e93-bd88-dc927e2a4b04 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:28.161686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126aaa-46b0-4e93-bd88-dc927e2a4b04 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:28.161784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a126aaa-46b0-4e93-bd88-dc927e2a4b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:28.215449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2a126aaa-46b0-4e93-bd88-dc927e2a4b04 None None] MFA Rules not processed for user `6c3f554c019a4907b55a6f779ff99631`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:28.216752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2a126aaa-46b0-4e93-bd88-dc927e2a4b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:28.323111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1166/2365] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:28.327623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:28.425341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254004bb-f35e-47cc-955b-3568d687fd54 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:28.457036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:28.458301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:28.458778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:28.459219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:28.460069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:28.462204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:28.529973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1200/2366] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:28 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:28.533927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a126aaa-46b0-4e93-bd88-dc927e2a4b04 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:28.555345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a126aaa-46b0-4e93-bd88-dc927e2a4b04 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:28.696005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:28.696986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:28.697353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:28.697838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:28.698509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:28.700951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:28.809938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:28.811264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1167/2367] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:28 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:28.830213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ca248-4df1-4663-a086-596506446da8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:28.843982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:28.844615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:28.844898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:28.845175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:28.845835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:28.847477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:28.891787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1201/2368] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:40:28.893370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:28.911035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972883a3-b95c-4370-8a8e-52e6f94716b3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:28.917520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:28.918774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:28.919263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:28.919745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] PATH_INFO: `/v3/projects/5aca40c5fdd7498da200cb716de48ca6/users/c2394680b8454e789c4c64121f993f7a/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:28.951777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aca40c5fdd7498da200cb716de48ca6, user_id=c2394680b8454e789c4c64121f993f7a, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:28.954791 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:28.981077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1168/2369] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:28 2022] PUT /identity/v3/projects/5aca40c5fdd7498da200cb716de48ca6/users/c2394680b8454e789c4c64121f993f7a/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:28.989082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:29.002446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a744d-911e-4287-9007-9eb5cafd6920 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:29.078996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cc4ef-bd46-42e3-b7a6-11438cec6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:29.080354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc4ef-bd46-42e3-b7a6-11438cec6c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:29.080643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc4ef-bd46-42e3-b7a6-11438cec6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:29.080922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cc4ef-bd46-42e3-b7a6-11438cec6c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:29.081608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cc4ef-bd46-42e3-b7a6-11438cec6c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:29.083226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cc4ef-bd46-42e3-b7a6-11438cec6c45 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:29.095729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1202/2370] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:29.103001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:29.114818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81e8d4-bb64-4e80-81e2-f8109bb7d24a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:29.119564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:29.123719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:29.123719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:29.123719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] PATH_INFO: `/v3/projects/5aca40c5fdd7498da200cb716de48ca6/users/c2394680b8454e789c4c64121f993f7a/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:29.125641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aca40c5fdd7498da200cb716de48ca6, user_id=c2394680b8454e789c4c64121f993f7a, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:29.128617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:29.145307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1169/2371] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:29 2022] PUT /identity/v3/projects/5aca40c5fdd7498da200cb716de48ca6/users/c2394680b8454e789c4c64121f993f7a/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:29.160475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f4b8-2b81-4399-b57e-59e23f93ced4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:29.160656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f4b8-2b81-4399-b57e-59e23f93ced4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:29.160909 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f4b8-2b81-4399-b57e-59e23f93ced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:29.198622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:29.204112 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e492f4b8-2b81-4399-b57e-59e23f93ced4 None None] MFA Rules not processed for user `c2394680b8454e789c4c64121f993f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:29.205494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e492f4b8-2b81-4399-b57e-59e23f93ced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:29.400055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1203/2372] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:29.412575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:29.415397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:29.481922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:29.507271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21be56-4df3-4615-b386-a434a9977951 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:29.513317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1303079-2754-4c6d-bf48-c0363fcd6b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:29.514019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1303079-2754-4c6d-bf48-c0363fcd6b82 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:29.514491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1303079-2754-4c6d-bf48-c0363fcd6b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:29.514875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1303079-2754-4c6d-bf48-c0363fcd6b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:29.630683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1303079-2754-4c6d-bf48-c0363fcd6b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:29.632556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1303079-2754-4c6d-bf48-c0363fcd6b82 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:29.645875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1170/2373] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:32.722319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492f4b8-2b81-4399-b57e-59e23f93ced4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:32.834668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492f4b8-2b81-4399-b57e-59e23f93ced4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:32.840442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:32.841317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:32.841658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:32.842005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] PATH_INFO: `/v3/users/6c3f554c019a4907b55a6f779ff99631` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:32.843240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3f554c019a4907b55a6f779ff99631)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:32.845826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:32.932350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3f554c019a4907b55a6f779ff99631'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:32.933950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3f554c019a4907b55a6f779ff99631'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:32.950703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3f554c019a4907b55a6f779ff99631'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:32.963980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3f554c019a4907b55a6f779ff99631'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:32.965255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3f554c019a4907b55a6f779ff99631'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:32.981122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1204/2374] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:32 2022] DELETE /identity/v3/users/6c3f554c019a4907b55a6f779ff99631 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:32.986615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:32.987202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:32.987437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:33.014564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:33.016293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:33.116124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1171/2375] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:33.127000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:33.128520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:33.165881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:33.229017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2491b-aa33-4b5c-bf48-e54bcdcbbed5 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:33.232995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:33.233618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:33.233915 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:33.234822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:33.260324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:33.263825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:33.275508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1205/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:33.692668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:33.694810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:33.731825 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d00c1d-ef50-4969-9c0b-ee368b85ac47 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:33.737701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:33.738479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:33.738830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:33.739665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] PATH_INFO: `/v3/projects/1e78c5f3d16e46e38c6a3280658d3f64` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:33.741914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e78c5f3d16e46e38c6a3280658d3f64)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:33.745510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:33.841171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e78c5f3d16e46e38c6a3280658d3f64', 'request_id': 'req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:33.855382 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e78c5f3d16e46e38c6a3280658d3f64', 'request_id': 'req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:33.867833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e78c5f3d16e46e38c6a3280658d3f64', 'request_id': 'req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:33.888562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] The token cache is being invalidate because project 1e78c5f3d16e46e38c6a3280658d3f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:33.888857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:33.889526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:33.891074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1172/2377] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:33 2022] DELETE /identity/v3/projects/1e78c5f3d16e46e38c6a3280658d3f64 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:33.895259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:33.908052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c486-da47-47d9-ab29-283905d81937 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:33.983375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:33.984120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:33.984429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:33.984684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] PATH_INFO: `/v3/users/c2394680b8454e789c4c64121f993f7a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:33.985903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2394680b8454e789c4c64121f993f7a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:33.987961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:34.050108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2394680b8454e789c4c64121f993f7a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.050846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2394680b8454e789c4c64121f993f7a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.073826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2394680b8454e789c4c64121f993f7a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.098302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2394680b8454e789c4c64121f993f7a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.099183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e9caeea7-3f09-4eb7-a8b1-42036b29d0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2394680b8454e789c4c64121f993f7a'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.133677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1206/2378] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:33 2022] DELETE /identity/v3/users/c2394680b8454e789c4c64121f993f7a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:34.520002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:34.524731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:34.539960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df1856-1db6-4ef4-a28f-0ca7f6cc0af3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:34.556101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:34.611803 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:34.612357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:34.612638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:34.612912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] PATH_INFO: `/v3/projects/5aca40c5fdd7498da200cb716de48ca6` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:34.614129 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aca40c5fdd7498da200cb716de48ca6)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:34.615988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:34.676025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aca40c5fdd7498da200cb716de48ca6', 'request_id': 'req-508e6e10-6fcb-4093-99f6-c9c329977c0e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.685629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aca40c5fdd7498da200cb716de48ca6', 'request_id': 'req-508e6e10-6fcb-4093-99f6-c9c329977c0e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.693392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aca40c5fdd7498da200cb716de48ca6', 'request_id': 'req-508e6e10-6fcb-4093-99f6-c9c329977c0e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.704828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] The token cache is being invalidate because project 5aca40c5fdd7498da200cb716de48ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:34.705123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.705925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-508e6e10-6fcb-4093-99f6-c9c329977c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:34.707431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1173/2379] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:34 2022] DELETE /identity/v3/projects/5aca40c5fdd7498da200cb716de48ca6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:34.712337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52072c1-31d2-4065-a54c-b9f7c622e146 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:34.712610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52072c1-31d2-4065-a54c-b9f7c622e146 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:34.712877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52072c1-31d2-4065-a54c-b9f7c622e146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:34.733506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b52072c1-31d2-4065-a54c-b9f7c622e146 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:34.734792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b52072c1-31d2-4065-a54c-b9f7c622e146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:34.770502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:34.797897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1207/2380] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:34.806735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e04d3-54ea-420a-ae23-0bf003e475f9 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:34.807027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e04d3-54ea-420a-ae23-0bf003e475f9 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:34.807302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e04d3-54ea-420a-ae23-0bf003e475f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:34.827882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b02e04d3-54ea-420a-ae23-0bf003e475f9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:34.829080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b02e04d3-54ea-420a-ae23-0bf003e475f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:34.836862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1174/2381] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:34.841411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52072c1-31d2-4065-a54c-b9f7c622e146 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:34.851475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52072c1-31d2-4065-a54c-b9f7c622e146 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:34.856319 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:34.856916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:34.857198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:34.857498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:34.858154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:40:34.858468 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:34.860153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:34.872366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1208/2382] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:40:34.876750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e04d3-54ea-420a-ae23-0bf003e475f9 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:34.886310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e04d3-54ea-420a-ae23-0bf003e475f9 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:34.891700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:34.892294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:34.892577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:34.892851 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:34.893492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:34.895398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:34.925970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1175/2383] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:34 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:34.927374 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:34.938407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24105e5e-d076-4159-b408-04d9a84dfb1c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:34.940595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:34.942272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:35.001454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.002072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.002354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.002635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.003266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.005524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.013403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767bfbb-0a6a-4f05-878e-9e3bc64ad0bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:35.018241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.019053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.019458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.019854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] PATH_INFO: `/v3/users/ad3e51391bfa495b94928c116fee715f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.021234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3e51391bfa495b94928c116fee715f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.023553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.027768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1209/2384] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:34 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:35.031751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:35.041697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fefb6-400b-4041-8b40-84bf6a305902 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:35.046819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.047427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.047894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.048179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.048826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.050474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.052159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:35.063027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1210/2385] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:35.066733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:35.078667 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f45e-a5b4-4485-9bae-3be9ce593dba admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:35.083487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3e51391bfa495b94928c116fee715f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.083661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.084193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3e51391bfa495b94928c116fee715f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.084315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.084504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.084779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.085420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.087014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.091601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3e51391bfa495b94928c116fee715f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.101583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1211/2386] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:35.102564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:35.102685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3e51391bfa495b94928c116fee715f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.104274 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:35.115236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-73fc16a6-8631-478c-b065-51f2c2034ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3e51391bfa495b94928c116fee715f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.118101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a68ad-9076-4385-823c-a1e923c57ae1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:35.125125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9eae-98f7-4906-a70a-0b0d6a39a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.125568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9eae-98f7-4906-a70a-0b0d6a39a993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.125966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9eae-98f7-4906-a70a-0b0d6a39a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.126245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9eae-98f7-4906-a70a-0b0d6a39a993 admin admin] PATH_INFO: `/v3/projects/7548f5656a63425f8b9ee096247fa096/users/e497dfba470e4058943400c73f3f3634/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.133181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1176/2387] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:34 2022] DELETE /identity/v3/users/ad3e51391bfa495b94928c116fee715f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:40:35.137957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.138266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.138503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.146450 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe9eae-98f7-4906-a70a-0b0d6a39a993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7548f5656a63425f8b9ee096247fa096, user_id=e497dfba470e4058943400c73f3f3634, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.149211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe9eae-98f7-4906-a70a-0b0d6a39a993 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.158476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:35.159998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:35.166385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1212/2388] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:35 2022] PUT /identity/v3/projects/7548f5656a63425f8b9ee096247fa096/users/e497dfba470e4058943400c73f3f3634/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:40:35.176804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.177410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.177410 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.209464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] MFA Rules not processed for user `e497dfba470e4058943400c73f3f3634`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:35.210708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:35.227684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1177/2389] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:35.238063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:35.239785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:35.285115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:35.295237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1213/2390] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:35.303178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:35.305059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:35.320590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd189040-6b1a-4e83-b6d4-9b300cce55bd None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:35.330667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.331539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.331929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.332413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.343027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.344607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.354830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1178/2391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:40:35.377045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25235d06-1ba0-4a27-ac0e-edd8c965a7a9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:35.381153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.381774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.382055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.382329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.392578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.394369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.410814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1214/2392] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:40:35.665561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:35.671840 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:35.698638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d356c6-b96d-4656-9fd2-cb577cd8b906 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:35.708496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:35.709145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:35.709433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:35.709779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] PATH_INFO: `/v3/projects/4dc60ac319384f30a8b8dcfa38d6f6a8` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:35.711688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc60ac319384f30a8b8dcfa38d6f6a8)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:35.713530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:35.764220 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:35.778550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc60ac319384f30a8b8dcfa38d6f6a8', 'request_id': 'req-2ea46614-886e-49b0-943d-a6f5962b4465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.794701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc60ac319384f30a8b8dcfa38d6f6a8', 'request_id': 'req-2ea46614-886e-49b0-943d-a6f5962b4465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.810051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc60ac319384f30a8b8dcfa38d6f6a8', 'request_id': 'req-2ea46614-886e-49b0-943d-a6f5962b4465'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.826141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] The token cache is being invalidate because project 4dc60ac319384f30a8b8dcfa38d6f6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:35.826542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.827267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2ea46614-886e-49b0-943d-a6f5962b4465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:35.829013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1179/2393] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:35 2022] DELETE /identity/v3/projects/4dc60ac319384f30a8b8dcfa38d6f6a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:38.067991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:38.086302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f0573-a0c8-4555-b97a-4d9e36d754fc service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:38.165579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:38.166144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:38.166421 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:38.166696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] PATH_INFO: `/v3/users/e497dfba470e4058943400c73f3f3634` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:38.167864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e497dfba470e4058943400c73f3f3634)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:38.170408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:38.219481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e497dfba470e4058943400c73f3f3634'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.220161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e497dfba470e4058943400c73f3f3634'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.232243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e497dfba470e4058943400c73f3f3634'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.239895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e497dfba470e4058943400c73f3f3634'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.240639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e497dfba470e4058943400c73f3f3634'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.253334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1215/2394] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:38 2022] DELETE /identity/v3/users/e497dfba470e4058943400c73f3f3634 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:38.258242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:38.258709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:38.258709 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:38.280385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:38.281593 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:38.339425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1180/2395] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:38.349567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:38.350950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:38.377197 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:38.411408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d137d02-edf1-4b7e-941d-2753b98eb45b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:38.415171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe639e-7ad4-422b-a9d6-3bfc078aa551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:38.415853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe639e-7ad4-422b-a9d6-3bfc078aa551 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:38.416085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe639e-7ad4-422b-a9d6-3bfc078aa551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:38.416360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe639e-7ad4-422b-a9d6-3bfc078aa551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:38.425768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe639e-7ad4-422b-a9d6-3bfc078aa551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:38.427214 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe639e-7ad4-422b-a9d6-3bfc078aa551 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:38.437009 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1216/2396] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:38.720632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:38.721932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:38.736956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df8fe-68f1-4e22-95fd-f7bab4b26ec2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:38.742345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:38.743065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:38.743348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:38.743655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] PATH_INFO: `/v3/projects/7548f5656a63425f8b9ee096247fa096` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:38.744839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7548f5656a63425f8b9ee096247fa096)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:38.748043 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:38.816464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7548f5656a63425f8b9ee096247fa096', 'request_id': 'req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.822619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7548f5656a63425f8b9ee096247fa096', 'request_id': 'req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.830969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7548f5656a63425f8b9ee096247fa096', 'request_id': 'req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.841329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] The token cache is being invalidate because project 7548f5656a63425f8b9ee096247fa096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:38.841619 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.842258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-1a4d4e40-6b94-44a5-a41d-3202b2b1c487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:38.843780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1181/2397] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:38 2022] DELETE /identity/v3/projects/7548f5656a63425f8b9ee096247fa096 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:38.848783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f009b-870e-49cc-a2fd-bfc8b4785440 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:38.849066 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f009b-870e-49cc-a2fd-bfc8b4785440 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:38.849345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f009b-870e-49cc-a2fd-bfc8b4785440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:38.870564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c22f009b-870e-49cc-a2fd-bfc8b4785440 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:38.872432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c22f009b-870e-49cc-a2fd-bfc8b4785440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:38.937685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1217/2398] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:38.948083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133647-2bb1-460d-9826-a5f5260b9d00 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:38.948376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133647-2bb1-460d-9826-a5f5260b9d00 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:38.948644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133647-2bb1-460d-9826-a5f5260b9d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:38.971207 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-78133647-2bb1-460d-9826-a5f5260b9d00 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:38.971957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-78133647-2bb1-460d-9826-a5f5260b9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:38.981155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1182/2399] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:38.985543 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f009b-870e-49cc-a2fd-bfc8b4785440 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:38.995475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f009b-870e-49cc-a2fd-bfc8b4785440 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.001177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.001815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.002232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.002512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.003175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:40:39.003480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.005404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.017987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1218/2400] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:40:39.022877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78133647-2bb1-460d-9826-a5f5260b9d00 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.032647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78133647-2bb1-460d-9826-a5f5260b9d00 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.037812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.038452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.038738 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.039015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.039694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.041656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.072149 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1183/2401] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:39 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:40:39.076967 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.087905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620711-cc3c-4c07-a335-f717bcab6911 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.157688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.158303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.158585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.158861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.159507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.161762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.188082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1219/2402] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:39 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:39.192228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.203006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e80bf-e595-4c0f-b3ea-1d603a8b922c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.208177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.208788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.209071 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.209346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.209999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.211616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.222294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1184/2403] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:40:39.226335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.237381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03393a8-b3c5-48ca-b426-bdf2d095afc3 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.242227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465cbfe-02a5-4c2e-bdad-9be126de10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.242996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465cbfe-02a5-4c2e-bdad-9be126de10c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.243286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465cbfe-02a5-4c2e-bdad-9be126de10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.243565 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465cbfe-02a5-4c2e-bdad-9be126de10c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.244243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465cbfe-02a5-4c2e-bdad-9be126de10c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.246494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465cbfe-02a5-4c2e-bdad-9be126de10c5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.258709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1220/2404] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:39.263540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.273923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710891b-1bdb-4b13-9fb5-8628c821cfc8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.279403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.280111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.280397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.280671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] PATH_INFO: `/v3/projects/27b8aeddcbd14654b45462d7bd8b2887/users/55babeb9e68648ab96f02a6954d61f68/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.283983 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:39.298227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b8aeddcbd14654b45462d7bd8b2887, user_id=55babeb9e68648ab96f02a6954d61f68, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.301479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.316279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1185/2405] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:39 2022] PUT /identity/v3/projects/27b8aeddcbd14654b45462d7bd8b2887/users/55babeb9e68648ab96f02a6954d61f68/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:40:39.327796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb41b8-c73b-415d-8157-2225a73bb1c9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.328303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb41b8-c73b-415d-8157-2225a73bb1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.328528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb41b8-c73b-415d-8157-2225a73bb1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.357896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d2cb41b8-c73b-415d-8157-2225a73bb1c9 None None] MFA Rules not processed for user `55babeb9e68648ab96f02a6954d61f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:39.359166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d2cb41b8-c73b-415d-8157-2225a73bb1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:39.379517 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:39.457989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1221/2406] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:39.469751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.471519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:39.531878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a64d4-1ae0-4fce-8674-bbf31f0ace3f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.535546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e13dc1-d4c8-4a84-b888-f6b307858a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.536180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e13dc1-d4c8-4a84-b888-f6b307858a0b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.536466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e13dc1-d4c8-4a84-b888-f6b307858a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.536739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e13dc1-d4c8-4a84-b888-f6b307858a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.545123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e13dc1-d4c8-4a84-b888-f6b307858a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.546552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e13dc1-d4c8-4a84-b888-f6b307858a0b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.555236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1186/2407] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:39.581318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb41b8-c73b-415d-8157-2225a73bb1c9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.644309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb41b8-c73b-415d-8157-2225a73bb1c9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.648994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.649629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.649911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.650189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] PATH_INFO: `/v3/users/55babeb9e68648ab96f02a6954d61f68` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.651336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55babeb9e68648ab96f02a6954d61f68)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.653553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.705850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55babeb9e68648ab96f02a6954d61f68'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:39.706425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55babeb9e68648ab96f02a6954d61f68'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:39.718704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55babeb9e68648ab96f02a6954d61f68'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:39.725914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55babeb9e68648ab96f02a6954d61f68'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:39.726537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55babeb9e68648ab96f02a6954d61f68'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:39.739379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1222/2408] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:40:39 2022] DELETE /identity/v3/users/55babeb9e68648ab96f02a6954d61f68 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:39.743876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.744163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.744439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.765531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:39.766734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:39.824001 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1187/2409] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:39.833663 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:39.835055 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:39.883464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:39.898671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa1cd-df35-4efd-a9e5-f1c402e92561 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:39.902585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502b2f-64c2-454b-a359-4f006f92397c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:39.903206 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502b2f-64c2-454b-a359-4f006f92397c service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:39.903490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502b2f-64c2-454b-a359-4f006f92397c service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:39.903795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502b2f-64c2-454b-a359-4f006f92397c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:39.913358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db502b2f-64c2-454b-a359-4f006f92397c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:39.914805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db502b2f-64c2-454b-a359-4f006f92397c service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:39.924903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1223/2410] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:40.207652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:40.209184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:40.228878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0214b2-d7e5-42e5-acac-c8e1673f717b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:40.234982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:40.235808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.236093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.236392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] PATH_INFO: `/v3/projects/27b8aeddcbd14654b45462d7bd8b2887` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.237636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b8aeddcbd14654b45462d7bd8b2887)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:40.239552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:40.290761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b8aeddcbd14654b45462d7bd8b2887', 'request_id': 'req-e9147634-d678-43f9-9c93-c7d65a917856'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:40.297610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b8aeddcbd14654b45462d7bd8b2887', 'request_id': 'req-e9147634-d678-43f9-9c93-c7d65a917856'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:40.305793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b8aeddcbd14654b45462d7bd8b2887', 'request_id': 'req-e9147634-d678-43f9-9c93-c7d65a917856'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:40.318189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] The token cache is being invalidate because project 27b8aeddcbd14654b45462d7bd8b2887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:40:40.318484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:40.319133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e9147634-d678-43f9-9c93-c7d65a917856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:40:40.320634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1188/2411] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:40:40 2022] DELETE /identity/v3/projects/27b8aeddcbd14654b45462d7bd8b2887 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:40.326557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538652a7-3337-40f7-a493-d3d26de7934d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.327019 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538652a7-3337-40f7-a493-d3d26de7934d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.327126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538652a7-3337-40f7-a493-d3d26de7934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.347111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-538652a7-3337-40f7-a493-d3d26de7934d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:40.348474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-538652a7-3337-40f7-a493-d3d26de7934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:40.412603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1224/2412] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:40.420350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2c27-c1d4-43ae-9042-cbc347f6c6c6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.420637 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2c27-c1d4-43ae-9042-cbc347f6c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.420909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe2c27-c1d4-43ae-9042-cbc347f6c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.441145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3dfe2c27-c1d4-43ae-9042-cbc347f6c6c6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:40.442349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3dfe2c27-c1d4-43ae-9042-cbc347f6c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:40.451164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1189/2413] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:40.455385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538652a7-3337-40f7-a493-d3d26de7934d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:40.471645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538652a7-3337-40f7-a493-d3d26de7934d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:40.476943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:40.477551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.477837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.478101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.478756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:40:40.479059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:40.481590 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:40.496802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1225/2414] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:40:40.499486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2c27-c1d4-43ae-9042-cbc347f6c6c6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:40.505769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:40.510033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe2c27-c1d4-43ae-9042-cbc347f6c6c6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:40.526618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:40.527291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.527573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.527875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.528524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:40.530431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:40.566543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1190/2415] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:40:40 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:40.567858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:40.580899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd54e5-6646-405d-b7e5-9a987b7e423d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:40.653652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:40.654331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.654621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.654897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.655714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:40.657756 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:40.687853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1226/2416] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:40:40 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:40:40.693613 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:40.715024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b75607-aaf3-4ed5-8e95-f88f71eae1db admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:40.727463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:40.728353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.730017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.730501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.731452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:40.735025 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:40.761115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1191/2417] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:40.767442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:40.788077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c50ba5-de14-4c2d-a8e9-20b114f455ee admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:40.795083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338347de-a9b4-4410-9b51-fa6429799617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:40.796488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338347de-a9b4-4410-9b51-fa6429799617 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.796863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338347de-a9b4-4410-9b51-fa6429799617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.797242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338347de-a9b4-4410-9b51-fa6429799617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.798277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338347de-a9b4-4410-9b51-fa6429799617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:40.800167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338347de-a9b4-4410-9b51-fa6429799617 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:40.820275 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1227/2418] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:40:40.821163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:40.852943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc346d6-3bd0-404b-b1e6-b5693ed67a2f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:40.861412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:40.862739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.862739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.862955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] PATH_INFO: `/v3/projects/ff88e56de61f4c48886366e28f797581/users/63bcb5a374cb4a4e982c804c9bccea07/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.882362 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff88e56de61f4c48886366e28f797581, user_id=63bcb5a374cb4a4e982c804c9bccea07, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:40.885919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:40.906603 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1192/2419] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:40:40 2022] PUT /identity/v3/projects/ff88e56de61f4c48886366e28f797581/users/63bcb5a374cb4a4e982c804c9bccea07/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:40:40.908184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a78d5-0ed3-4a68-85df-a5495f476ab4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:40.908679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a78d5-0ed3-4a68-85df-a5495f476ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:40.908983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a78d5-0ed3-4a68-85df-a5495f476ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:40.930490 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ef7a78d5-0ed3-4a68-85df-a5495f476ab4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:40.931738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ef7a78d5-0ed3-4a68-85df-a5495f476ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:41.000772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:41.021141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1228/2420] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:41.031222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:41.033093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:41.102951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f203d8-a335-4d5a-bcfc-83827681963c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:41.109089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47856cf4-9eaf-46bb-a1c3-678f17e81fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:41.109827 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856cf4-9eaf-46bb-a1c3-678f17e81fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.110113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856cf4-9eaf-46bb-a1c3-678f17e81fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.110424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856cf4-9eaf-46bb-a1c3-678f17e81fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.121974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47856cf4-9eaf-46bb-a1c3-678f17e81fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:41.123512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47856cf4-9eaf-46bb-a1c3-678f17e81fd9 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:41.135302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1193/2421] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:41.227127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98bf0-0dae-49f0-92cd-347c92a91e01 None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.227811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98bf0-0dae-49f0-92cd-347c92a91e01 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.228117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98bf0-0dae-49f0-92cd-347c92a91e01 None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.229626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1229/2422] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:40:41.237274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c120-b941-44ec-bedc-d96f3d9451ef None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.237651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c120-b941-44ec-bedc-d96f3d9451ef None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.238072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c120-b941-44ec-bedc-d96f3d9451ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.259123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3939c120-b941-44ec-bedc-d96f3d9451ef None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:41.260462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3939c120-b941-44ec-bedc-d96f3d9451ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:41.334867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1194/2423] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:40:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:41.346906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98bf0-0dae-49f0-92cd-347c92a91e01 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:41.348859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a1c98bf0-0dae-49f0-92cd-347c92a91e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:41.412281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98bf0-0dae-49f0-92cd-347c92a91e01 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:41.416326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3e55-d3d1-4bd4-9b89-2ef84105dde5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717ade6a084349a8864cf15ce0d827fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:41.417146 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3e55-d3d1-4bd4-9b89-2ef84105dde5 service glance] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.418296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3e55-d3d1-4bd4-9b89-2ef84105dde5 service glance] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.418577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3e55-d3d1-4bd4-9b89-2ef84105dde5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.429504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3e55-d3d1-4bd4-9b89-2ef84105dde5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:41.430962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3e55-d3d1-4bd4-9b89-2ef84105dde5 service glance] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:41.442932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1230/2424] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:41.518140 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07a9f-bc7f-4bfd-b750-65596dadddc7 None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.518737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07a9f-bc7f-4bfd-b750-65596dadddc7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.519085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07a9f-bc7f-4bfd-b750-65596dadddc7 None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.520599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1195/2425] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 10:40:41.531955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c56fa-262b-4259-9d0b-bad1a3674538 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.532280 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c56fa-262b-4259-9d0b-bad1a3674538 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.532763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c56fa-262b-4259-9d0b-bad1a3674538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.554912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ba4c56fa-262b-4259-9d0b-bad1a3674538 None None] MFA Rules not processed for user `e5f6af1603974cdba70d0d7d78e6777d`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:41.556182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ba4c56fa-262b-4259-9d0b-bad1a3674538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:41.563893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1231/2426] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:40:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:41.576212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07a9f-bc7f-4bfd-b750-65596dadddc7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:41.578019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c4f07a9f-bc7f-4bfd-b750-65596dadddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:41.591557 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07a9f-bc7f-4bfd-b750-65596dadddc7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:41.595283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596f557-debe-4494-a85f-b2864da63972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:41.595940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f557-debe-4494-a85f-b2864da63972 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.596091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f557-debe-4494-a85f-b2864da63972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.596370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f557-debe-4494-a85f-b2864da63972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.603783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596f557-debe-4494-a85f-b2864da63972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:41.605491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596f557-debe-4494-a85f-b2864da63972 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:41.614047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1196/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:41.707452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a96a-5124-4ce5-aeea-3649f47f6c0a None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.707807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a96a-5124-4ce5-aeea-3649f47f6c0a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.708076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a96a-5124-4ce5-aeea-3649f47f6c0a None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.709409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1232/2428] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:40:41.715109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d4792-7efb-4257-8de1-d43bbb7acb6d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.715566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d4792-7efb-4257-8de1-d43bbb7acb6d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.715861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d4792-7efb-4257-8de1-d43bbb7acb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.738966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-790d4792-7efb-4257-8de1-d43bbb7acb6d None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:41.740427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-790d4792-7efb-4257-8de1-d43bbb7acb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:41.751943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1197/2429] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:40:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:40:41.773285 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214a96a-5124-4ce5-aeea-3649f47f6c0a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:41.786389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214a96a-5124-4ce5-aeea-3649f47f6c0a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:41.790227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:41.791365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:41.791754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:41.792097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:41.805453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:41.807552 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:41.821400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1233/2430] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:42.143491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3fd59-b60d-4224-9b90-69c4d8dc6144 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:42.143807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3fd59-b60d-4224-9b90-69c4d8dc6144 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:42.144081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3fd59-b60d-4224-9b90-69c4d8dc6144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:42.188865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-11b3fd59-b60d-4224-9b90-69c4d8dc6144 None None] MFA Rules not processed for user `63bcb5a374cb4a4e982c804c9bccea07`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:42.190336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11b3fd59-b60d-4224-9b90-69c4d8dc6144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:42.223422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:42.304925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1198/2431] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:42.317400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:42.321057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:42.398596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1b94-07be-46dc-b451-edd0b1f06f30 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:42.403850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c64a-fe96-4424-bb09-d1f8a5fb0bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:42.404466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c64a-fe96-4424-bb09-d1f8a5fb0bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:42.404747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c64a-fe96-4424-bb09-d1f8a5fb0bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:42.405020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c64a-fe96-4424-bb09-d1f8a5fb0bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:42.414239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6c64a-fe96-4424-bb09-d1f8a5fb0bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:42.415792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6c64a-fe96-4424-bb09-d1f8a5fb0bc0 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:42.426427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1234/2432] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:40:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:40:43.948272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:43.950194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:43.950761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:43.971790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] MFA Rules not processed for user `63bcb5a374cb4a4e982c804c9bccea07`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:43.973248 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:43.983141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1199/2433] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:45.255907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8bbe5-fcf9-4bea-afa7-27d4d883fa1e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:45.256396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8bbe5-fcf9-4bea-afa7-27d4d883fa1e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:45.256510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8bbe5-fcf9-4bea-afa7-27d4d883fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:45.277086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-eed8bbe5-fcf9-4bea-afa7-27d4d883fa1e None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:40:45.278287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-eed8bbe5-fcf9-4bea-afa7-27d4d883fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:45.359289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1235/2434] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:40:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:40:45.372996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:40:45.374573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:40:45.466229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6c18b-416a-4c30-a60c-44c9d1a786ff None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:40:45.474021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:40:45.475009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:40:45.475500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:40:45.476069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:40:45.490110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:40:45.493385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:40:45.507433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1200/2435] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:40:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 10:40:55.347141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:40:55.501874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=57 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:41:03.852299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7531-0638-4b10-8ce9-4e0e2b543923 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:03.852765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7531-0638-4b10-8ce9-4e0e2b543923 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:03.852867 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7531-0638-4b10-8ce9-4e0e2b543923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:03.876419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a0ce7531-0638-4b10-8ce9-4e0e2b543923 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:03.877916 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a0ce7531-0638-4b10-8ce9-4e0e2b543923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:03.886559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1236/2436] 10.222.0.16 () {58 vars in 967 bytes} [Mon Sep 5 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:41:03.911188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:03.922835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c3785-0337-4c54-b58f-0d8eed4217f1 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:03.928535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620e670-c2f4-4f30-addc-5bc23ae640b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:03.929210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620e670-c2f4-4f30-addc-5bc23ae640b0 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:03.929561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620e670-c2f4-4f30-addc-5bc23ae640b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:03.929903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620e670-c2f4-4f30-addc-5bc23ae640b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:03.939673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620e670-c2f4-4f30-addc-5bc23ae640b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:03.941254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620e670-c2f4-4f30-addc-5bc23ae640b0 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:03.950209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1201/2437] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:41:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:41:08.697573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7531-0638-4b10-8ce9-4e0e2b543923 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:08.708182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7531-0638-4b10-8ce9-4e0e2b543923 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:08.711793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3cb08-f872-4bc8-963a-b82e573bdfc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:08.712399 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3cb08-f872-4bc8-963a-b82e573bdfc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:08.712680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3cb08-f872-4bc8-963a-b82e573bdfc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:08.712959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3cb08-f872-4bc8-963a-b82e573bdfc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:08.715209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-25a3cb08-f872-4bc8-963a-b82e573bdfc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:08.808035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3cb08-f872-4bc8-963a-b82e573bdfc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:08.809983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3cb08-f872-4bc8-963a-b82e573bdfc6 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:08.821451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1237/2438] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:41:11.049032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:11.050413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:11.050850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:11.080744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] MFA Rules not processed for user `96e9216d8a994f03b50eb64fa6516f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:11.082048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:11.193328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1202/2439] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:41:18.816029 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=33 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:41:21.169687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=31 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:41:32.126361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dafa4-f38a-4c4d-8c15-544a3a7c5164 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:32.126917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dafa4-f38a-4c4d-8c15-544a3a7c5164 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:32.126917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dafa4-f38a-4c4d-8c15-544a3a7c5164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:32.147238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-801dafa4-f38a-4c4d-8c15-544a3a7c5164 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:32.148488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-801dafa4-f38a-4c4d-8c15-544a3a7c5164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:32.156957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1238/2440] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:41:32.179360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:32.180841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:32.197547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdea73-77ec-4ec4-8ffe-f0a00a6910f3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:32.203139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:32.203793 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:32.204136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:32.204351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:32.213045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:32.214624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:32.224062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1203/2441] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:41:35.121659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266dad6-29b6-43a3-a6e7-cf8f25b28dae None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:35.122217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266dad6-29b6-43a3-a6e7-cf8f25b28dae None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:35.122350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266dad6-29b6-43a3-a6e7-cf8f25b28dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:35.142696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-1266dad6-29b6-43a3-a6e7-cf8f25b28dae None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:35.143935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1266dad6-29b6-43a3-a6e7-cf8f25b28dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:35.151792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1239/2442] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:41:35.173920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:35.175312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:35.190378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc401e-7415-44d8-ae5e-4eb7f3f25466 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:35.195781 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:35.196376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:35.196700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:35.196971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:35.204902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:35.206458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:35.216240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1204/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:41:38.356514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4111-cb01-4604-ac34-b5ca7bb5cbf4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:38.357040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4111-cb01-4604-ac34-b5ca7bb5cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:38.357040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4111-cb01-4604-ac34-b5ca7bb5cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:38.378079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-103d4111-cb01-4604-ac34-b5ca7bb5cbf4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:38.379268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-103d4111-cb01-4604-ac34-b5ca7bb5cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:38.387864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1240/2444] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:41:38.417426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:38.428639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea6788-fb0e-4224-ad9d-e6cc3b7de4fe service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:38.434085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:38.434681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:38.434966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:38.435245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:38.443240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:38.444841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:38.454511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1205/2445] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:41:41.423666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cc43-f86a-4da3-a9fc-2e80bf9405d8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:41.424148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cc43-f86a-4da3-a9fc-2e80bf9405d8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:41.424273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0cc43-f86a-4da3-a9fc-2e80bf9405d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:41.443755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f7f0cc43-f86a-4da3-a9fc-2e80bf9405d8 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:41.445064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f7f0cc43-f86a-4da3-a9fc-2e80bf9405d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:41.452817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1241/2446] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:41:41.475705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:41.487329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6cfac-83d3-4c22-86f2-086de15d2aee service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:41.492730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:41.493317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:41.493600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:41.493876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:41.501858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:41.503425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:41.513177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1206/2447] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:41:45.642213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786352-0ba3-40d6-b7df-7d4e1dc458f5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:45.642701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786352-0ba3-40d6-b7df-7d4e1dc458f5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:45.642796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31786352-0ba3-40d6-b7df-7d4e1dc458f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:45.663175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-31786352-0ba3-40d6-b7df-7d4e1dc458f5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:45.664395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-31786352-0ba3-40d6-b7df-7d4e1dc458f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:45.672366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1242/2448] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:41:45.702266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:45.713389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef90f48-e8bd-4144-b4b4-5ae9dad9850e service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:45.719556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:45.720183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:45.720465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:45.720745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:45.728836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:45.730474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:45.739865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1207/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:41:49.818614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:49.819117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:49.819215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:49.839091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:41:49.841067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:41:49.848848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1243/2450] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:41:49.883053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:41:49.894974 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae51e43-dd90-4e10-baa1-2c9e96c2bc0b service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:41:49.900455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bc8e8-9f17-4e41-8793-29a133adec5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:41:49.901064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc8e8-9f17-4e41-8793-29a133adec5a service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:41:49.901346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc8e8-9f17-4e41-8793-29a133adec5a service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:41:49.901618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc8e8-9f17-4e41-8793-29a133adec5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:41:49.910672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bc8e8-9f17-4e41-8793-29a133adec5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:41:49.912312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bc8e8-9f17-4e41-8793-29a133adec5a service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:41:49.921992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1208/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:41:59.833989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=18 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:41:59.917457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=36 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:42:02.010154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:42:02.011614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:02.089721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e859b8f-f658-4911-b7e8-4f1ee5e91bb5 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:42:02.095126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ecdbd-8e43-4c42-9f4b-cd0bcac163f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:42:02.095864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ecdbd-8e43-4c42-9f4b-cd0bcac163f0 service placement] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:02.096332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ecdbd-8e43-4c42-9f4b-cd0bcac163f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:02.096688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ecdbd-8e43-4c42-9f4b-cd0bcac163f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:02.098614 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2c2ecdbd-8e43-4c42-9f4b-cd0bcac163f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:02.111218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ecdbd-8e43-4c42-9f4b-cd0bcac163f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:42:02.112854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ecdbd-8e43-4c42-9f4b-cd0bcac163f0 service placement] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:42:02.123269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1244/2452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:42:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:42:07.345033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c836fd-8750-4a6b-9e39-3c71d7c5139f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:07.346336 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c836fd-8750-4a6b-9e39-3c71d7c5139f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:07.347152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c836fd-8750-4a6b-9e39-3c71d7c5139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:07.370011 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-75c836fd-8750-4a6b-9e39-3c71d7c5139f None None] MFA Rules not processed for user `63bcb5a374cb4a4e982c804c9bccea07`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:07.372483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-75c836fd-8750-4a6b-9e39-3c71d7c5139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:07.387746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1209/2453] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:42:10.696509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f0b8-fdb6-434c-8093-27935f71443f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:10.696904 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f0b8-fdb6-434c-8093-27935f71443f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:10.697048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f0b8-fdb6-434c-8093-27935f71443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:10.720380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ebf7f0b8-fdb6-434c-8093-27935f71443f None None] MFA Rules not processed for user `c2632b005b784efc8fcbe90cb7376529`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:10.721749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ebf7f0b8-fdb6-434c-8093-27935f71443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:10.780921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1245/2454] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:42:17.364433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:42:20.773696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=57 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:42:22.907398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aafeb-53e0-4327-9f8e-aed001964016 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:22.908102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aafeb-53e0-4327-9f8e-aed001964016 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:22.908102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aafeb-53e0-4327-9f8e-aed001964016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:22.931520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1a4aafeb-53e0-4327-9f8e-aed001964016 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:22.932174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1a4aafeb-53e0-4327-9f8e-aed001964016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:22.940759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1210/2455] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:42:22.962956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7f0b8-fdb6-434c-8093-27935f71443f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:42:22.975941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7f0b8-fdb6-434c-8093-27935f71443f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:42:22.981289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:42:22.981931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:22.982207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:22.982498 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:22.991051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:42:22.992647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:42:23.002651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1246/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:42:27.252874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095820ed-1793-400a-b61a-162cb5e69137 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:27.253475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095820ed-1793-400a-b61a-162cb5e69137 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:27.253475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095820ed-1793-400a-b61a-162cb5e69137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:27.276188 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-095820ed-1793-400a-b61a-162cb5e69137 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:27.277390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-095820ed-1793-400a-b61a-162cb5e69137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:27.286828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1211/2457] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:42:27.314336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:42:27.325480 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1870b29-2b5d-4f3f-aaf4-fb3acc3b7b1d service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:42:27.331770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:42:27.332386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:27.332669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:27.332971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:27.341511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:42:27.343109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:42:27.353419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1247/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:42:30.330262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa4a7e-f1f5-4815-aa21-6ceaaf6a2176 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:30.330750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa4a7e-f1f5-4815-aa21-6ceaaf6a2176 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:30.330849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa4a7e-f1f5-4815-aa21-6ceaaf6a2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:30.350288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-daaa4a7e-f1f5-4815-aa21-6ceaaf6a2176 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:30.351474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-daaa4a7e-f1f5-4815-aa21-6ceaaf6a2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:30.359237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1212/2459] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:42:30.380806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:42:30.391895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffbc21-ca69-4618-b0a3-e636018ad4a9 service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:42:30.397488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:42:30.398080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:30.398358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:30.398630 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:30.406815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:42:30.408792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:42:30.418123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1248/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:42:34.578381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845212f9-ed1b-4dee-b89f-c8820c914e1f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:34.579037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845212f9-ed1b-4dee-b89f-c8820c914e1f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:34.579037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845212f9-ed1b-4dee-b89f-c8820c914e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:34.601081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-845212f9-ed1b-4dee-b89f-c8820c914e1f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:34.602384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-845212f9-ed1b-4dee-b89f-c8820c914e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:34.611670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1213/2461] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:42:34.632809 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:42:34.644767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af44d97-42a2-4b11-b9b2-0f71d0b0d1ed service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:42:34.651141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a316ba4-1708-47ea-967a-ff4e8b4492d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:42:34.651830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a316ba4-1708-47ea-967a-ff4e8b4492d5 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:34.652181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a316ba4-1708-47ea-967a-ff4e8b4492d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:34.652531 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a316ba4-1708-47ea-967a-ff4e8b4492d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:34.663114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a316ba4-1708-47ea-967a-ff4e8b4492d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:42:34.665053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a316ba4-1708-47ea-967a-ff4e8b4492d5 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:42:34.677386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1249/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:42:36.450918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e35be-9d20-4962-a3ae-d1e2ed5deea5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:36.451409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e35be-9d20-4962-a3ae-d1e2ed5deea5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:36.451655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e35be-9d20-4962-a3ae-d1e2ed5deea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:36.472799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-064e35be-9d20-4962-a3ae-d1e2ed5deea5 None None] MFA Rules not processed for user `a0cb2ecdde264e8f863d6f8f024371af`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:36.474189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-064e35be-9d20-4962-a3ae-d1e2ed5deea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:36.528085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1214/2463] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:42:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:42:37.741785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531329c-16c6-46ac-a0f4-4a4df341f866 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:37.742307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531329c-16c6-46ac-a0f4-4a4df341f866 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:37.742405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531329c-16c6-46ac-a0f4-4a4df341f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:37.762303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-6531329c-16c6-46ac-a0f4-4a4df341f866 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:37.763509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6531329c-16c6-46ac-a0f4-4a4df341f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:37.777597 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1250/2464] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Sep 5 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:42:37.797671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e35be-9d20-4962-a3ae-d1e2ed5deea5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:42:37.812388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e35be-9d20-4962-a3ae-d1e2ed5deea5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:42:37.818726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:42:37.819341 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:37.819653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:37.819934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:37.828470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:42:37.830907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:42:37.840882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1215/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:42:47.757291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=27 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:42:47.836411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=43 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:42:52.084284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d18e1-1161-4eab-aeed-5f874934db73 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:42:52.084808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d18e1-1161-4eab-aeed-5f874934db73 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:42:52.084808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d18e1-1161-4eab-aeed-5f874934db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:42:52.110300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a93d18e1-1161-4eab-aeed-5f874934db73 None None] MFA Rules not processed for user `96e9216d8a994f03b50eb64fa6516f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:42:52.111524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a93d18e1-1161-4eab-aeed-5f874934db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:42:52.118447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1251/2466] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:42:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:43:02.099723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:43:09.336708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:09.348521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e385-2a76-47ab-aebe-4cabb4fccfe4 service nova] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:09.353232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:09.353893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:09.354177 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:09.354456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] PATH_INFO: `/v3/users/63bcb5a374cb4a4e982c804c9bccea07` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:09.355639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bcb5a374cb4a4e982c804c9bccea07)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:09.357561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:09.404347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bcb5a374cb4a4e982c804c9bccea07'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.405005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bcb5a374cb4a4e982c804c9bccea07'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.405615 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bcb5a374cb4a4e982c804c9bccea07'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.413215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bcb5a374cb4a4e982c804c9bccea07'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.425013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bcb5a374cb4a4e982c804c9bccea07'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.437424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1216/2467] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:43:09 2022] DELETE /identity/v3/users/63bcb5a374cb4a4e982c804c9bccea07 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:43:09.618829 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d18e1-1161-4eab-aeed-5f874934db73 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:09.630785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d18e1-1161-4eab-aeed-5f874934db73 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:09.694139 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:09.694777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:09.695057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:09.695326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] PATH_INFO: `/v3/projects/ff88e56de61f4c48886366e28f797581` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:09.697223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff88e56de61f4c48886366e28f797581)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:09.699128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:09.749345 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff88e56de61f4c48886366e28f797581', 'request_id': 'req-5d197507-5753-4022-a05c-037257f879a8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.756099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff88e56de61f4c48886366e28f797581', 'request_id': 'req-5d197507-5753-4022-a05c-037257f879a8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.767919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff88e56de61f4c48886366e28f797581', 'request_id': 'req-5d197507-5753-4022-a05c-037257f879a8'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.783920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] The token cache is being invalidate because project ff88e56de61f4c48886366e28f797581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:43:09.784215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.784874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:43:09.786376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1252/2468] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:43:09 2022] DELETE /identity/v3/projects/ff88e56de61f4c48886366e28f797581 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:43:19.433949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:43:19.780251 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:43:21.518712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:21.520274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:21.577396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c979ff-79c8-4b71-85ac-2a1dd2651a4a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:21.625378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec0b8-d589-42bc-9bb3-675d6f1254f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:21.625985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec0b8-d589-42bc-9bb3-675d6f1254f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:21.626267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec0b8-d589-42bc-9bb3-675d6f1254f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:21.626544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec0b8-d589-42bc-9bb3-675d6f1254f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:21.628364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e4cec0b8-d589-42bc-9bb3-675d6f1254f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:21.698156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec0b8-d589-42bc-9bb3-675d6f1254f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:21.699611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec0b8-d589-42bc-9bb3-675d6f1254f6 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:21.710678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1217/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:22.894763 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:22.896199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:22.909167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d197507-5753-4022-a05c-037257f879a8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:22.912776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:22.913370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:22.913650 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:22.913925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:22.915582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:22.929010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:22.930471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:22.941388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1253/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:30.292871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:30.293426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:30.293426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:30.315168 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:43:30.316426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:30.372708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1218/2471] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:43:30.423174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:30.424598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:30.502745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1b2b2-b0b3-4a30-890a-19fdff428743 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:30.507810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:30.508417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:30.508694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:30.508966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:30.517059 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:30.518649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:30.526495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1254/2472] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:43:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:43:32.354611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:32.356529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:32.371855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:43:32.381741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9349c7-8a8a-462e-9f56-bb3e00f22479 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:32.393318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245ce5e-0d6b-473c-aade-594abb1652df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:32.393955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ce5e-0d6b-473c-aade-594abb1652df service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:32.394244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ce5e-0d6b-473c-aade-594abb1652df service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:32.394546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ce5e-0d6b-473c-aade-594abb1652df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:32.396739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d245ce5e-0d6b-473c-aade-594abb1652df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:32.492569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245ce5e-0d6b-473c-aade-594abb1652df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:32.494752 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245ce5e-0d6b-473c-aade-594abb1652df service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:32.509074 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1219/2473] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:34.025195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:34.026694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:34.129516 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f596f6e-f7b2-4061-ba7d-5399bf368bf3 service swift] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:34.133337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321682c-5cb1-4f10-bc2d-4341c0f29deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:34.133901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321682c-5cb1-4f10-bc2d-4341c0f29deb service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:34.134184 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321682c-5cb1-4f10-bc2d-4341c0f29deb service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:34.134473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321682c-5cb1-4f10-bc2d-4341c0f29deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:34.136910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5321682c-5cb1-4f10-bc2d-4341c0f29deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:34.207694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321682c-5cb1-4f10-bc2d-4341c0f29deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:34.209201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321682c-5cb1-4f10-bc2d-4341c0f29deb service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:34.219220 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1255/2474] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:42.501134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=27 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:43:44.215165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=86 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:43:48.050063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee53e05-3db0-432d-9734-39cc2b98b90e None None] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.050927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee53e05-3db0-432d-9734-39cc2b98b90e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.051431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee53e05-3db0-432d-9734-39cc2b98b90e None None] PATH_INFO: `/` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.053274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1220/2475] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:43:48.060417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b859e-c60c-411e-beba-07e7a8de8d1f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.061448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b859e-c60c-411e-beba-07e7a8de8d1f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.061717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b859e-c60c-411e-beba-07e7a8de8d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.093287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5c9b859e-c60c-411e-beba-07e7a8de8d1f None None] MFA Rules not processed for user `e5f6af1603974cdba70d0d7d78e6777d`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:43:48.095115 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5c9b859e-c60c-411e-beba-07e7a8de8d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:48.109523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1256/2476] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:43:48.128756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee53e05-3db0-432d-9734-39cc2b98b90e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:48.153996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee53e05-3db0-432d-9734-39cc2b98b90e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:48.158922 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95948b-807c-4efc-8b9b-d723e7392f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:48.159530 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95948b-807c-4efc-8b9b-d723e7392f4b service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.160186 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95948b-807c-4efc-8b9b-d723e7392f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.160472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95948b-807c-4efc-8b9b-d723e7392f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.169704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95948b-807c-4efc-8b9b-d723e7392f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:48.171378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95948b-807c-4efc-8b9b-d723e7392f4b service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:48.191426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1221/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:48.290342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51d63-a7ad-472f-89d8-2458f6bffdfd None None] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.292449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51d63-a7ad-472f-89d8-2458f6bffdfd None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.293047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51d63-a7ad-472f-89d8-2458f6bffdfd None None] PATH_INFO: `/` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.294782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1257/2478] 10.222.0.16 () {54 vars in 921 bytes} [Mon Sep 5 10:43:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 10:43:48.301100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.301606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.301910 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.326360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] MFA Rules not processed for user `bc87886676534d46bee21984a515c138`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:43:48.328141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:48.338063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1222/2479] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Sep 5 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:43:48.349691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e51d63-a7ad-472f-89d8-2458f6bffdfd None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:48.362396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e51d63-a7ad-472f-89d8-2458f6bffdfd None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:48.372572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:48.373424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.373925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.374393 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.386455 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:48.389352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:48.401435 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1258/2480] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:48.472418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:48.474082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:48.547691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae8378-d5d0-4875-b6d8-ffb817e5c857 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:48.556539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:48.557226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.557226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.557459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.559446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:48.573601 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:48.575696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:48.593659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1223/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:48.771505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:48.780881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835ef0a-8fc0-4ccb-8bd7-7e7fd670419d service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:48.784738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50c084-3cee-44be-9638-eac78474aefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:48.785351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50c084-3cee-44be-9638-eac78474aefb service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:48.785692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50c084-3cee-44be-9638-eac78474aefb service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:48.785898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50c084-3cee-44be-9638-eac78474aefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:48.789120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3b50c084-3cee-44be-9638-eac78474aefb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:48.806594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50c084-3cee-44be-9638-eac78474aefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:48.808750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50c084-3cee-44be-9638-eac78474aefb service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:48.822994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1259/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:52.251767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:52.264155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5fcbf-5c4b-4dbb-a8fd-3b2ded98585c service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:52.268488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:52.269290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:52.269577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:52.269854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:52.271689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:52.284450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:52.286016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:52.294926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1224/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:43:55.559381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461336-0e71-4444-9243-8aee72e60838 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:55.559936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461336-0e71-4444-9243-8aee72e60838 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:55.560040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461336-0e71-4444-9243-8aee72e60838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:55.589849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-55461336-0e71-4444-9243-8aee72e60838 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:43:55.591705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-55461336-0e71-4444-9243-8aee72e60838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:55.627357 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:55.635336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1260/2484] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:43:55.646430 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927dbde-70ba-48d2-ba62-d303f1bccfb5 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:55.651148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461336-0e71-4444-9243-8aee72e60838 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:43:55.659508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:55.660179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:55.660556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:55.661168 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:55.673324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461336-0e71-4444-9243-8aee72e60838 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:43:55.674059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:55.676508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:55.679412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:43:55.680111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:43:55.680390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:43:55.680659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:43:55.682583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:43:55.693968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1225/2485] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:43:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:43:55.712905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:43:55.715316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:43:55.747126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1261/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:43:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:44:00.318565 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:00.328517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdca52-09fb-4fd2-8fb2-39e0900e0258 service swift] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:00.332264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:00.332930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:00.333278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:00.333622 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:00.335424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:00.412554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:00.414284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:00.427754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1226/2487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:04.713513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:04.714955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:04.731616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be7183-ac72-4096-b665-54e9932f15ba service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:04.736688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:04.737323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:04.737604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:04.737874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] PATH_INFO: `/v3/users/a0cb2ecdde264e8f863d6f8f024371af` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:04.738985 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cb2ecdde264e8f863d6f8f024371af)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:04.740974 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:04.789964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cb2ecdde264e8f863d6f8f024371af'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:04.790690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cb2ecdde264e8f863d6f8f024371af'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:04.806679 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cb2ecdde264e8f863d6f8f024371af'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:04.816939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cb2ecdde264e8f863d6f8f024371af'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:04.817963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-395fdd63-c863-46d4-86a2-e8f480ef3175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cb2ecdde264e8f863d6f8f024371af'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:04.830812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1262/2488] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:04 2022] DELETE /identity/v3/users/a0cb2ecdde264e8f863d6f8f024371af => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:05.000632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.011089 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e9bba-0314-45d6-8e6f-fef5bab631bb service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.049049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:05.072252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.072891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.073171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.073445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] PATH_INFO: `/v3/projects/b72375e5c57d48069779914aad2a8db7` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.074594 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72375e5c57d48069779914aad2a8db7)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.076607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.123005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72375e5c57d48069779914aad2a8db7', 'request_id': 'req-f500f7cb-5e3a-470d-be8a-e9e651f65312'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:05.130079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72375e5c57d48069779914aad2a8db7', 'request_id': 'req-f500f7cb-5e3a-470d-be8a-e9e651f65312'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:05.137462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72375e5c57d48069779914aad2a8db7', 'request_id': 'req-f500f7cb-5e3a-470d-be8a-e9e651f65312'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:05.147911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] The token cache is being invalidate because project b72375e5c57d48069779914aad2a8db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:05.148256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:05.148890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-f500f7cb-5e3a-470d-be8a-e9e651f65312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:05.150375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1227/2489] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:04 2022] DELETE /identity/v3/projects/b72375e5c57d48069779914aad2a8db7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:05.155912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9a71-385d-46a4-8814-00226c2bf10c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.156204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9a71-385d-46a4-8814-00226c2bf10c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.156485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e9a71-385d-46a4-8814-00226c2bf10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.177419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-6c0e9a71-385d-46a4-8814-00226c2bf10c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:05.178620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6c0e9a71-385d-46a4-8814-00226c2bf10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:05.237045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1263/2490] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:05.244918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523de65-80f6-4441-aaa0-76b659be7161 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.245206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523de65-80f6-4441-aaa0-76b659be7161 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.245511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523de65-80f6-4441-aaa0-76b659be7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.265531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8523de65-80f6-4441-aaa0-76b659be7161 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:05.266842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8523de65-80f6-4441-aaa0-76b659be7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:05.275035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1228/2491] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:05.278997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9a71-385d-46a4-8814-00226c2bf10c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.289944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e9a71-385d-46a4-8814-00226c2bf10c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.294633 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.295957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.296328 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.296653 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.297270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:05.297575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.299202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.318354 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1264/2492] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:44:05.320181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523de65-80f6-4441-aaa0-76b659be7161 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.329945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523de65-80f6-4441-aaa0-76b659be7161 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.335282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.335924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.336226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.336494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.337136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.339699 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.371037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1229/2493] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:05 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:05.375208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.387961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c067-51ec-4151-aa2e-62c37205856b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.392520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:05.447515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.448156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.448435 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.448703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.449337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.452290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.478822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1265/2494] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:05 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:05.480458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.492533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0e72f-d38d-466d-a598-8ed45287dfc1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.500051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.500688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.501162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.501496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.502181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.504046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.515807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1230/2495] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:05.519716 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.530089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2d3c6-25f4-4a42-abed-645aa421648a admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.535485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4594b8-78da-4448-a5c8-6c5ce8c155ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.536142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4594b8-78da-4448-a5c8-6c5ce8c155ff admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.536423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4594b8-78da-4448-a5c8-6c5ce8c155ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.536694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4594b8-78da-4448-a5c8-6c5ce8c155ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.537359 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4594b8-78da-4448-a5c8-6c5ce8c155ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.538939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4594b8-78da-4448-a5c8-6c5ce8c155ff admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.551537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1266/2496] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:05.555304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.566422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844af32-edf2-4f02-9aab-1c14683f3e47 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.571009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.571690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.571971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.572245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] PATH_INFO: `/v3/projects/5d1f7caa0ecf4dbcb3cd4f86947696c9/users/02cd85dc55c44e0395311e692a602c75/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.587476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d1f7caa0ecf4dbcb3cd4f86947696c9, user_id=02cd85dc55c44e0395311e692a602c75, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.590246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.603162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1231/2497] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:05 2022] PUT /identity/v3/projects/5d1f7caa0ecf4dbcb3cd4f86947696c9/users/02cd85dc55c44e0395311e692a602c75/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:05.615104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867da9-e299-413d-b532-6f79b0c23563 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.615389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867da9-e299-413d-b532-6f79b0c23563 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.615700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867da9-e299-413d-b532-6f79b0c23563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.643842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-cd867da9-e299-413d-b532-6f79b0c23563 None None] MFA Rules not processed for user `02cd85dc55c44e0395311e692a602c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:05.645043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cd867da9-e299-413d-b532-6f79b0c23563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:05.709128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1267/2498] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:05.713645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.778252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac910f-0162-47d3-ad09-beecfc23bf74 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.783487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.784127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.784412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.784706 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.785319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.787265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.797756 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:05.816894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1232/2499] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:05 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:05.820846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd867da9-e299-413d-b532-6f79b0c23563 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.832712 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd867da9-e299-413d-b532-6f79b0c23563 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.908062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.908673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.909000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.909278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.909959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.912237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.939290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1268/2500] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:05 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:05.943408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.954932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be961a5-5419-4505-8c59-33bcc6243716 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.959677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.960350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.960695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.961035 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:05.961681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:05.963281 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:05.975019 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1233/2501] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:05.979034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:05.986417 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:05.990509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5782e2-4e79-48c2-86f6-736adce57480 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:05.996419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:05.997079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:05.997355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:05.997691 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] PATH_INFO: `/v3/projects/945d9d3286434b6eb300c4fa1918e183/users/53e88937b01b4c19ac0ae349e6c7a60f/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.016016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945d9d3286434b6eb300c4fa1918e183, user_id=53e88937b01b4c19ac0ae349e6c7a60f, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:06.018680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:06.032651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1269/2502] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:05 2022] PUT /identity/v3/projects/945d9d3286434b6eb300c4fa1918e183/users/53e88937b01b4c19ac0ae349e6c7a60f/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:06.036465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:06.046930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d69ba5-1a48-46e4-94c8-3a6bf3003645 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:06.106942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9454d-c1fb-4f4e-be9b-01b773cb4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:06.107552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9454d-c1fb-4f4e-be9b-01b773cb4c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:06.107862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9454d-c1fb-4f4e-be9b-01b773cb4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:06.108137 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9454d-c1fb-4f4e-be9b-01b773cb4c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.108775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9454d-c1fb-4f4e-be9b-01b773cb4c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:06.110397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9454d-c1fb-4f4e-be9b-01b773cb4c0d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:06.123609 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1234/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:06.125122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:06.135852 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1b5c5-8d19-407d-84aa-3666556ff645 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:06.141145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:06.141791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:06.142072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:06.142348 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] PATH_INFO: `/v3/projects/945d9d3286434b6eb300c4fa1918e183/users/53e88937b01b4c19ac0ae349e6c7a60f/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.144287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945d9d3286434b6eb300c4fa1918e183, user_id=53e88937b01b4c19ac0ae349e6c7a60f, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:06.146933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:06.157011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1270/2504] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:06 2022] PUT /identity/v3/projects/945d9d3286434b6eb300c4fa1918e183/users/53e88937b01b4c19ac0ae349e6c7a60f/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:06.166963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625459b-bf60-4812-b099-f26914f51237 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:06.167251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625459b-bf60-4812-b099-f26914f51237 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:06.167529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625459b-bf60-4812-b099-f26914f51237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.196419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2625459b-bf60-4812-b099-f26914f51237 None None] MFA Rules not processed for user `53e88937b01b4c19ac0ae349e6c7a60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:06.197645 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2625459b-bf60-4812-b099-f26914f51237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:06.268017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1235/2505] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:06.279325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:06.281069 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:06.341065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74757fd4-8647-4819-8633-9482f1ab4d36 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:06.346561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed133f91-96d7-4004-ab94-0732bd4ed122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:06.347873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed133f91-96d7-4004-ab94-0732bd4ed122 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:06.349073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed133f91-96d7-4004-ab94-0732bd4ed122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:06.349489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed133f91-96d7-4004-ab94-0732bd4ed122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.359569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed133f91-96d7-4004-ab94-0732bd4ed122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:06.361170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed133f91-96d7-4004-ab94-0732bd4ed122 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:06.371158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1271/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:06.440040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625459b-bf60-4812-b099-f26914f51237 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:06.512606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625459b-bf60-4812-b099-f26914f51237 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:06.517602 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:06.518236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:06.518529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:06.518787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] PATH_INFO: `/v3/users/02cd85dc55c44e0395311e692a602c75` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.519956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=02cd85dc55c44e0395311e692a602c75)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:06.521872 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:06.523544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:06.576846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02cd85dc55c44e0395311e692a602c75'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:06.577676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02cd85dc55c44e0395311e692a602c75'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:06.578285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02cd85dc55c44e0395311e692a602c75'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:06.586017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02cd85dc55c44e0395311e692a602c75'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:06.601166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02cd85dc55c44e0395311e692a602c75'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:06.622632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1236/2507] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:06 2022] DELETE /identity/v3/users/02cd85dc55c44e0395311e692a602c75 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:06.627981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:06.628542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:06.629233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.651258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:06.652527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:06.716694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1272/2508] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:06.728746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:06.730217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:06.794303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c1272-bc07-4d35-b9fe-8fb13bbbdbef admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:06.798564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:06.799163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:06.799441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:06.799743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:06.811682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:06.813134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:06.822932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1237/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:07.154043 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:07.156295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:07.168987 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c73ce-84e4-44cc-8c09-6e45e305f53c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:07.174279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:07.174966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:07.175250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:07.175914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] PATH_INFO: `/v3/projects/5d1f7caa0ecf4dbcb3cd4f86947696c9` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:07.176743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d1f7caa0ecf4dbcb3cd4f86947696c9)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:07.178821 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:07.230472 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d1f7caa0ecf4dbcb3cd4f86947696c9', 'request_id': 'req-558c1654-41c5-4328-a99c-ffbe7d2a7695'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.236098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d1f7caa0ecf4dbcb3cd4f86947696c9', 'request_id': 'req-558c1654-41c5-4328-a99c-ffbe7d2a7695'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.242161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d1f7caa0ecf4dbcb3cd4f86947696c9', 'request_id': 'req-558c1654-41c5-4328-a99c-ffbe7d2a7695'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.244697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:07.256286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] The token cache is being invalidate because project 5d1f7caa0ecf4dbcb3cd4f86947696c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:07.256586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.257191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.258695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1273/2510] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:07 2022] DELETE /identity/v3/projects/5d1f7caa0ecf4dbcb3cd4f86947696c9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:07.262764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:07.273124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468def17-3e43-4ff2-9204-456eb2da46e5 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:07.328732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:07.329360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:07.329644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:07.329919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] PATH_INFO: `/v3/users/53e88937b01b4c19ac0ae349e6c7a60f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:07.331029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e88937b01b4c19ac0ae349e6c7a60f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:07.332999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:07.355719 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:07.380592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e88937b01b4c19ac0ae349e6c7a60f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.381175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e88937b01b4c19ac0ae349e6c7a60f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.381775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e88937b01b4c19ac0ae349e6c7a60f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.388553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e88937b01b4c19ac0ae349e6c7a60f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.400659 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-9d4c17a9-43c2-4b8e-a0ca-1fcb594519df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e88937b01b4c19ac0ae349e6c7a60f'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.413454 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1238/2511] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:07 2022] DELETE /identity/v3/users/53e88937b01b4c19ac0ae349e6c7a60f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:07.680474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:07.682151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:07.696136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c1654-41c5-4328-a99c-ffbe7d2a7695 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:07.767254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:07.767934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:07.768212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:07.768483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] PATH_INFO: `/v3/projects/945d9d3286434b6eb300c4fa1918e183` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:07.769625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945d9d3286434b6eb300c4fa1918e183)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:07.771574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:07.827520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945d9d3286434b6eb300c4fa1918e183', 'request_id': 'req-7609d197-61f4-4150-a6fb-70727b626d93'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.835027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945d9d3286434b6eb300c4fa1918e183', 'request_id': 'req-7609d197-61f4-4150-a6fb-70727b626d93'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.845895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945d9d3286434b6eb300c4fa1918e183', 'request_id': 'req-7609d197-61f4-4150-a6fb-70727b626d93'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.861448 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] The token cache is being invalidate because project 945d9d3286434b6eb300c4fa1918e183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:07.862324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.862983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-7609d197-61f4-4150-a6fb-70727b626d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:07.865286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1274/2512] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:07 2022] DELETE /identity/v3/projects/945d9d3286434b6eb300c4fa1918e183 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:07.870210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766c4f-2f84-48f8-b831-b73c879c82a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:07.870505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766c4f-2f84-48f8-b831-b73c879c82a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:07.870811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766c4f-2f84-48f8-b831-b73c879c82a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:07.892314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-7e766c4f-2f84-48f8-b831-b73c879c82a2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:07.893536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7e766c4f-2f84-48f8-b831-b73c879c82a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:07.955866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1239/2513] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:07.964232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:07.964559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:07.964835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:07.985458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:07.986583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:07.994835 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1275/2514] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:07.999412 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766c4f-2f84-48f8-b831-b73c879c82a2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.009481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766c4f-2f84-48f8-b831-b73c879c82a2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.015039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.015682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.016093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.016375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.017024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:08.017328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.018940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.036455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1240/2515] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:44:08.037363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.038345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.040031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:08.050684 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b63f6-415c-49a4-a0d1-098bfd29c624 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.056561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.057420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.057986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.058507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.059434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.062396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.110639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1241/2516] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:08 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:08.115028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.155342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e3435-d0f5-4aa2-906b-cd6764a1c95b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.185145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:08.203982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72bf8a-4c8d-47be-bcc2-5ea68df4f705 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.208976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.209560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.209847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.210131 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.210795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.212775 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.224725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:08.236694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1242/2517] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:08 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:08.240591 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.251939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.252209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6365-d130-4161-b061-2d0117d906ea admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.252753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.253128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.253497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.259836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.260290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:08.260486 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.260732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.261075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.261652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.263264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.273964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.277301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.284211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1243/2518] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:08.287913 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.294242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1276/2519] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:08.301167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531732e2-3a1d-42e6-94d3-ad77b01903ef admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.305952 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d34b3d-ce79-418d-a6c6-39acc72c44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.307029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34b3d-ce79-418d-a6c6-39acc72c44ad admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.307317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34b3d-ce79-418d-a6c6-39acc72c44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.307613 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d34b3d-ce79-418d-a6c6-39acc72c44ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.308273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d34b3d-ce79-418d-a6c6-39acc72c44ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.309994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d34b3d-ce79-418d-a6c6-39acc72c44ad admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.322464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1244/2520] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:08.326981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.338796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc332d26-4036-4b7e-b679-1987242db1d7 service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.344276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.344955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.345235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.345512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] PATH_INFO: `/v3/projects/244319432ab6442cb6928c2ffcc44a9c/users/a725f41b4f804b0684b297ea56994075/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.363136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244319432ab6442cb6928c2ffcc44a9c, user_id=a725f41b4f804b0684b297ea56994075, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.365999 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.381577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1277/2521] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:08 2022] PUT /identity/v3/projects/244319432ab6442cb6928c2ffcc44a9c/users/a725f41b4f804b0684b297ea56994075/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:08.393105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d2ae-0ebb-4b44-8e63-925e6484e4bb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.393463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d2ae-0ebb-4b44-8e63-925e6484e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.393808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d2ae-0ebb-4b44-8e63-925e6484e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.427267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-8a84d2ae-0ebb-4b44-8e63-925e6484e4bb None None] MFA Rules not processed for user `a725f41b4f804b0684b297ea56994075`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:08.428759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a84d2ae-0ebb-4b44-8e63-925e6484e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:08.497278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1245/2522] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:08.502611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.568215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31a99f-b415-485c-b7f0-b925a7874128 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.572894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.573501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.573784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.574061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.574704 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.576828 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.606483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1278/2523] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:08 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:08.608263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d2ae-0ebb-4b44-8e63-925e6484e4bb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.618800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d2ae-0ebb-4b44-8e63-925e6484e4bb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.674445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.675054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.675335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.675661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.676252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.678173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.699886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1246/2524] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:08 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:08.703948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.714344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012bfb2-f83f-4cdf-ac7c-d27205213272 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.719191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.719814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.720099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.720371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.721012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.722619 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.733391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1279/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:08.737626 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.747882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f80d62-d3bc-4bbc-a184-00f6057f123d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.753144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.754042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.754322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.754592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] PATH_INFO: `/v3/projects/099977716e604552a9a82c8eba0f879d/users/006e94c3c7d743868674b8f6c2a9130b/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.769331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099977716e604552a9a82c8eba0f879d, user_id=006e94c3c7d743868674b8f6c2a9130b, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.772067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.785279 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1247/2526] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:08 2022] PUT /identity/v3/projects/099977716e604552a9a82c8eba0f879d/users/006e94c3c7d743868674b8f6c2a9130b/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:08.789166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.799803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00368e-996c-45ce-bcd5-916616e3149d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.845950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:08.856099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36dd6e-6c98-4d24-933d-ef8067f63ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.856703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36dd6e-6c98-4d24-933d-ef8067f63ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.856986 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36dd6e-6c98-4d24-933d-ef8067f63ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.857263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36dd6e-6c98-4d24-933d-ef8067f63ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.858453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36dd6e-6c98-4d24-933d-ef8067f63ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.860722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36dd6e-6c98-4d24-933d-ef8067f63ef4 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.870368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1280/2527] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:08.874824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:08.885670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10999e-7ed0-4b6f-b37b-fe5db71e6385 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:08.890491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:08.891440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.891542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.891830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] PATH_INFO: `/v3/projects/099977716e604552a9a82c8eba0f879d/users/006e94c3c7d743868674b8f6c2a9130b/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.893853 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099977716e604552a9a82c8eba0f879d, user_id=006e94c3c7d743868674b8f6c2a9130b, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:08.896567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:08.908318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1248/2528] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:08 2022] PUT /identity/v3/projects/099977716e604552a9a82c8eba0f879d/users/006e94c3c7d743868674b8f6c2a9130b/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:08.918342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d6b02-ec88-443a-ad5a-b15b04a5dc90 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:08.918627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d6b02-ec88-443a-ad5a-b15b04a5dc90 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:08.918912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d6b02-ec88-443a-ad5a-b15b04a5dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:08.948726 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0a3d6b02-ec88-443a-ad5a-b15b04a5dc90 None None] MFA Rules not processed for user `006e94c3c7d743868674b8f6c2a9130b`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:08.950022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0a3d6b02-ec88-443a-ad5a-b15b04a5dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:09.019886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1281/2529] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:09.031786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:09.033497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:09.053874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:09.094364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40361eed-be2d-419c-a790-b4c789d5fc80 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:09.098105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636d2b1-218f-411c-a300-eb3cb2ff5137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:09.098708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d2b1-218f-411c-a300-eb3cb2ff5137 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:09.098987 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d2b1-218f-411c-a300-eb3cb2ff5137 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:09.099260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d2b1-218f-411c-a300-eb3cb2ff5137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:09.108808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636d2b1-218f-411c-a300-eb3cb2ff5137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:09.110246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636d2b1-218f-411c-a300-eb3cb2ff5137 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:09.119445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1249/2530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:09.203012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d6b02-ec88-443a-ad5a-b15b04a5dc90 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:09.212847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d6b02-ec88-443a-ad5a-b15b04a5dc90 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:09.216449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:09.217861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:09.218362 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:09.218640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:09.279977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:09.281429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:09.290667 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1282/2531] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:11.590869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286f2f-714a-48ab-afe3-0d6985aaa2d0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:11.591342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286f2f-714a-48ab-afe3-0d6985aaa2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:11.595033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286f2f-714a-48ab-afe3-0d6985aaa2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:11.615664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-58286f2f-714a-48ab-afe3-0d6985aaa2d0 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:11.616868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-58286f2f-714a-48ab-afe3-0d6985aaa2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:11.674251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1250/2532] 10.222.0.16 () {58 vars in 967 bytes} [Mon Sep 5 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:11.689230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:11.690759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:11.767558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31081b7-16d3-4ae8-9535-fbcc5737f224 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:11.777002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1108d-e3f8-492b-af2e-d86a11432cae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:11.777623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1108d-e3f8-492b-af2e-d86a11432cae service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:11.777906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1108d-e3f8-492b-af2e-d86a11432cae service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:11.778185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1108d-e3f8-492b-af2e-d86a11432cae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:11.787818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1108d-e3f8-492b-af2e-d86a11432cae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:11.789454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1108d-e3f8-492b-af2e-d86a11432cae service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:11.795875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:11.804236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1283/2533] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:44:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:44:14.204795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58286f2f-714a-48ab-afe3-0d6985aaa2d0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:14.272009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58286f2f-714a-48ab-afe3-0d6985aaa2d0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:14.276694 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:14.278235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:14.278235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:14.278235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] PATH_INFO: `/v3/users/a725f41b4f804b0684b297ea56994075` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:14.280069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a725f41b4f804b0684b297ea56994075)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:14.282260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:14.335316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a725f41b4f804b0684b297ea56994075'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:14.336077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a725f41b4f804b0684b297ea56994075'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:14.336691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a725f41b4f804b0684b297ea56994075'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:14.346801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a725f41b4f804b0684b297ea56994075'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:14.357962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:14.366571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a725f41b4f804b0684b297ea56994075'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:14.390441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1251/2534] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:14 2022] DELETE /identity/v3/users/a725f41b4f804b0684b297ea56994075 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:14.392353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:14.392863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:14.393316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:14.414760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:14.422745 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:14.501227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1284/2535] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:14.511449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:14.514290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:14.584794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4e78-b3e4-4586-b990-5e85faa567a6 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:14.589018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:14.589690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:14.590093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:14.590476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:14.601704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:14.603364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:14.614394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1252/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:14.937506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:14.939389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:14.961781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458d371-6b2e-462a-9855-869205a45e25 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:14.968722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:14.969367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:14.969647 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:14.970122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] PATH_INFO: `/v3/projects/244319432ab6442cb6928c2ffcc44a9c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:14.971191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244319432ab6442cb6928c2ffcc44a9c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:14.973442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:15.024947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244319432ab6442cb6928c2ffcc44a9c', 'request_id': 'req-da67ccb9-7b12-4653-9624-72fa05d4fa53'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.031181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244319432ab6442cb6928c2ffcc44a9c', 'request_id': 'req-da67ccb9-7b12-4653-9624-72fa05d4fa53'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.037793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244319432ab6442cb6928c2ffcc44a9c', 'request_id': 'req-da67ccb9-7b12-4653-9624-72fa05d4fa53'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.051079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] The token cache is being invalidate because project 244319432ab6442cb6928c2ffcc44a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:15.051458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.052162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.053926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1285/2537] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:14 2022] DELETE /identity/v3/projects/244319432ab6442cb6928c2ffcc44a9c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:15.057743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:15.068141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b0f17-0d7d-4417-939d-4c637322e4cf service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:15.143582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:15.144246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:15.144529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:15.144806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] PATH_INFO: `/v3/users/006e94c3c7d743868674b8f6c2a9130b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:15.145954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] RBAC: Authorizing `identity:delete_user(user_id=006e94c3c7d743868674b8f6c2a9130b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:15.147977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:15.196878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006e94c3c7d743868674b8f6c2a9130b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.197961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006e94c3c7d743868674b8f6c2a9130b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.198571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006e94c3c7d743868674b8f6c2a9130b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.207226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006e94c3c7d743868674b8f6c2a9130b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.220586 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-143be9fe-0b8f-4925-8500-acec6a2e909f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006e94c3c7d743868674b8f6c2a9130b'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.233721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1253/2538] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:15 2022] DELETE /identity/v3/users/006e94c3c7d743868674b8f6c2a9130b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:15.664913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:15.666379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:15.682367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ccb9-7b12-4653-9624-72fa05d4fa53 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:15.768788 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:15.769593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:15.769912 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:15.770265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] PATH_INFO: `/v3/projects/099977716e604552a9a82c8eba0f879d` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:15.772152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=099977716e604552a9a82c8eba0f879d)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:15.774152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:15.815336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:15.845789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099977716e604552a9a82c8eba0f879d', 'request_id': 'req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.852629 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099977716e604552a9a82c8eba0f879d', 'request_id': 'req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.860135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099977716e604552a9a82c8eba0f879d', 'request_id': 'req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.877159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] The token cache is being invalidate because project 099977716e604552a9a82c8eba0f879d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:15.877475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.878265 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ffb7f7bb-4fdf-436c-ab31-4e31407d0d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:15.880425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1286/2539] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:15 2022] DELETE /identity/v3/projects/099977716e604552a9a82c8eba0f879d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:15.885018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16328-3a7e-485e-9ca2-1d79504cf0d0 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:15.885887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16328-3a7e-485e-9ca2-1d79504cf0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:15.885887 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16328-3a7e-485e-9ca2-1d79504cf0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:15.895525 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:15.912415 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d8e16328-3a7e-485e-9ca2-1d79504cf0d0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:15.914017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d8e16328-3a7e-485e-9ca2-1d79504cf0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.003408 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1254/2540] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:16.011557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeae17-dc6b-41fb-b12a-192e4c06daf9 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.011875 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeae17-dc6b-41fb-b12a-192e4c06daf9 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.012157 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeae17-dc6b-41fb-b12a-192e4c06daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.036409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b9eeae17-dc6b-41fb-b12a-192e4c06daf9 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:16.037655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b9eeae17-dc6b-41fb-b12a-192e4c06daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.048529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1287/2541] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:16.055049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16328-3a7e-485e-9ca2-1d79504cf0d0 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.075364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16328-3a7e-485e-9ca2-1d79504cf0d0 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.082247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.082891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.083265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.083573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.084966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:16.085369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.087255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.103759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1255/2542] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:44:16.108845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeae17-dc6b-41fb-b12a-192e4c06daf9 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.125535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeae17-dc6b-41fb-b12a-192e4c06daf9 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.133119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.134013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.134469 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.134746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.135401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.137392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.171003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1288/2543] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:16.174863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.185514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d7d2-e81a-484d-8664-6d28ad8e6549 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.249707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.250416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.250648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.250895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.251618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.253876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.275853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.277900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1256/2544] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:16.278169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.282168 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.292451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b6194-7411-42a5-be0b-0b46fbebb2ed admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.293353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d976ca8-14bc-4e97-a081-7bedde59a1f6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.298006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.298172 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.298617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.298764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.298896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.299047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.299156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.299322 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] PATH_INFO: `/v3/users/96e9216d8a994f03b50eb64fa6516f51` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.299848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.300491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e9216d8a994f03b50eb64fa6516f51)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.301541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.302431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.319402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1257/2545] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:16.323453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.333936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32f623-1fbd-4458-b373-8b01c4d13891 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.338677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.339273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.339556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.339866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.340796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.342210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.352643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1258/2546] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:16.352775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e9216d8a994f03b50eb64fa6516f51'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.353344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e9216d8a994f03b50eb64fa6516f51'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.356434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.358375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.366231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e9216d8a994f03b50eb64fa6516f51'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.371574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2e01b-fcb1-4ce1-8bcc-5c64e52174a9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.377640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.378317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.378854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.379147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] PATH_INFO: `/v3/projects/e37e672e72cd41a3b25334ec95c5830e/users/c6fc1a8a269642b280513d3f87b0b00f/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.381086 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e9216d8a994f03b50eb64fa6516f51'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.381836 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cc9ba9f7-d138-4a22-af11-e13ab393541e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e9216d8a994f03b50eb64fa6516f51'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.394927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37e672e72cd41a3b25334ec95c5830e, user_id=c6fc1a8a269642b280513d3f87b0b00f, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.395310 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1289/2547] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:16 2022] DELETE /identity/v3/users/96e9216d8a994f03b50eb64fa6516f51 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:16.400680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.415665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1259/2548] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:16 2022] PUT /identity/v3/projects/e37e672e72cd41a3b25334ec95c5830e/users/c6fc1a8a269642b280513d3f87b0b00f/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:16.425674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.425960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.426396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.457872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] MFA Rules not processed for user `c6fc1a8a269642b280513d3f87b0b00f`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:16.459165 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.506063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:16.529124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1290/2549] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:16.533698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.580212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:16.583384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.585329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.612199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4692db-6cd9-48e5-b612-6e8e81b08300 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.617646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.618256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.618539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.618815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.619445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.621404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.650912 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1260/2550] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:16.654930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.660439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df6230-1328-4c0e-99eb-b950836bb1cc None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.716703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.717386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.717647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b84d0-6005-40f0-be4a-56802ea18d00 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.717798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.717994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] PATH_INFO: `/v3/projects/be65a2826afc45b2a915174101c26f63` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.719129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be65a2826afc45b2a915174101c26f63)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.721211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.722543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.723156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.723801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.724110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.724749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.726673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.755972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1261/2551] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:16.757293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.766774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16155298-e9fb-4429-92cf-33c11abadffa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.769195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be65a2826afc45b2a915174101c26f63', 'request_id': 'req-c3069d18-ff10-46ce-b371-f72087febd63'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.774843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be65a2826afc45b2a915174101c26f63', 'request_id': 'req-c3069d18-ff10-46ce-b371-f72087febd63'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.781443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be65a2826afc45b2a915174101c26f63', 'request_id': 'req-c3069d18-ff10-46ce-b371-f72087febd63'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.795407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] The token cache is being invalidate because project be65a2826afc45b2a915174101c26f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:16.795768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.796358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c3069d18-ff10-46ce-b371-f72087febd63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:16.797929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1291/2552] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:16 2022] DELETE /identity/v3/projects/be65a2826afc45b2a915174101c26f63 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:16.802820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8a7cc-476a-4a93-9fb5-507256f9f108 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.803137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8a7cc-476a-4a93-9fb5-507256f9f108 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.803414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8a7cc-476a-4a93-9fb5-507256f9f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.823518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-25c8a7cc-476a-4a93-9fb5-507256f9f108 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:16.824249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.824782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-25c8a7cc-476a-4a93-9fb5-507256f9f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.824903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.825135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.825416 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.826745 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.828386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.833782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1292/2553] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:16.838487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1262/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:16.841324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29f278-379d-4a7a-b26b-d854be2e3040 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.842178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29f278-379d-4a7a-b26b-d854be2e3040 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.842463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29f278-379d-4a7a-b26b-d854be2e3040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.843322 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.845155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.857765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a725-8d5c-405e-b08f-537e4bc7f71c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.862028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-8c29f278-379d-4a7a-b26b-d854be2e3040 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:16.862536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.863192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.863301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8c29f278-379d-4a7a-b26b-d854be2e3040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:16.863477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.863796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] PATH_INFO: `/v3/projects/bbb95a9f011d4766af94a37cfbad73ab/users/c4176eab5457423e8e926e6569ef30c6/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.871383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1293/2555] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:16.875694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29f278-379d-4a7a-b26b-d854be2e3040 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.879185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb95a9f011d4766af94a37cfbad73ab, user_id=c4176eab5457423e8e926e6569ef30c6, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.881933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.884927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29f278-379d-4a7a-b26b-d854be2e3040 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.890740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.891338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.891651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.891931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.892582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:16.892887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.894503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.897547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1263/2556] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:16 2022] PUT /identity/v3/projects/bbb95a9f011d4766af94a37cfbad73ab/users/c4176eab5457423e8e926e6569ef30c6/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:16.901514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.901700 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:16.911648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1294/2557] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:44:16.913053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:16.923147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac60f-17f6-480a-9e35-1f5fa517822c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.929141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:16.968656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8f2b5-3e08-4035-85dc-6a36843ab2e8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:16.973455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.974116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.974729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.974947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.975500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.977173 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.984117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:16.984735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:16.985014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:16.985292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:16.985930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:16.987862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:16.988020 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1264/2558] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:16.991949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.002233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa88a7-4681-43ad-80a7-409c94fe6a99 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.007326 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19242f-072e-4922-8a25-ab443d19decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.008069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19242f-072e-4922-8a25-ab443d19decd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.008367 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19242f-072e-4922-8a25-ab443d19decd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.008672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19242f-072e-4922-8a25-ab443d19decd admin admin] PATH_INFO: `/v3/projects/bbb95a9f011d4766af94a37cfbad73ab/users/c4176eab5457423e8e926e6569ef30c6/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.011135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19242f-072e-4922-8a25-ab443d19decd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb95a9f011d4766af94a37cfbad73ab, user_id=c4176eab5457423e8e926e6569ef30c6, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.014800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19242f-072e-4922-8a25-ab443d19decd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.017774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1295/2559] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:16 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:17.021656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.025902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1265/2560] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:16 2022] PUT /identity/v3/projects/bbb95a9f011d4766af94a37cfbad73ab/users/c4176eab5457423e8e926e6569ef30c6/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:17.036233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.036520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.036797 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.066205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] MFA Rules not processed for user `c4176eab5457423e8e926e6569ef30c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:17.067397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:17.084444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0525907-bb4b-431e-8a0f-6bcec7c06275 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.141253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1266/2561] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:17.143200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.143841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.144121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.144394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.145028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.147089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.152134 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.153480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:17.170387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1296/2562] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:17 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:17.174329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.184331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cabed7-c25b-4e32-b5bb-b9470e810062 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.189279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.189873 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.190154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.190429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.191062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.192715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.206119 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1297/2563] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:17.206920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.212023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991f99e-de5f-455d-9d9a-0ca09ffecfe2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.215669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.216272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.216917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850c6a-592a-446e-a718-ca6e5103ff36 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.217092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.217377 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.221746 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aa60d-b61d-4ab8-ad82-5848f1d5a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.222260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa60d-b61d-4ab8-ad82-5848f1d5a418 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.222539 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa60d-b61d-4ab8-ad82-5848f1d5a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.222808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa60d-b61d-4ab8-ad82-5848f1d5a418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.223548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aa60d-b61d-4ab8-ad82-5848f1d5a418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.225148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aa60d-b61d-4ab8-ad82-5848f1d5a418 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.226349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.227156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:17.227814 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.240288 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1267/2564] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:44:17.240669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1298/2565] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:17.241324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.252265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d48edd-253b-4d60-9fd5-b99a8c430555 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.258092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.258847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.259264 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.259546 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] PATH_INFO: `/v3/projects/038a8e3e53704cc6815702ca9f45a3e4/users/a7208e971103430bbe92093565112932/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.277371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038a8e3e53704cc6815702ca9f45a3e4, user_id=a7208e971103430bbe92093565112932, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.280190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.294238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1268/2566] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:17 2022] PUT /identity/v3/projects/038a8e3e53704cc6815702ca9f45a3e4/users/a7208e971103430bbe92093565112932/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:17.305750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d072d-aa26-42b5-ba45-ea7614c2333a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.306042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d072d-aa26-42b5-ba45-ea7614c2333a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.306318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d072d-aa26-42b5-ba45-ea7614c2333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.340813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-fb4d072d-aa26-42b5-ba45-ea7614c2333a None None] MFA Rules not processed for user `a7208e971103430bbe92093565112932`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:17.342316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-fb4d072d-aa26-42b5-ba45-ea7614c2333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:17.414228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1299/2567] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:17.426777 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.428778 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:17.440275 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:17.512507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb15fb-a258-43aa-b64d-17a704685f71 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.518610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d444b2-ce6e-4f75-a00a-1dbc6e851572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.519222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d444b2-ce6e-4f75-a00a-1dbc6e851572 service nova] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.519503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d444b2-ce6e-4f75-a00a-1dbc6e851572 service nova] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.519813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d444b2-ce6e-4f75-a00a-1dbc6e851572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.527772 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d444b2-ce6e-4f75-a00a-1dbc6e851572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.530491 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d444b2-ce6e-4f75-a00a-1dbc6e851572 service nova] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.539121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1269/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:17.829439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d072d-aa26-42b5-ba45-ea7614c2333a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:17.908219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d072d-aa26-42b5-ba45-ea7614c2333a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:17.912769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:17.913406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:17.913738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:17.914015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] PATH_INFO: `/v3/users/c6fc1a8a269642b280513d3f87b0b00f` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:17.915321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fc1a8a269642b280513d3f87b0b00f)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:17.917411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:17.964932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fc1a8a269642b280513d3f87b0b00f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:17.965589 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fc1a8a269642b280513d3f87b0b00f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:17.977859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fc1a8a269642b280513d3f87b0b00f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:17.985204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fc1a8a269642b280513d3f87b0b00f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:17.985826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fc1a8a269642b280513d3f87b0b00f'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:17.998662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1300/2569] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:17 2022] DELETE /identity/v3/users/c6fc1a8a269642b280513d3f87b0b00f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:18.003179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:18.003404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:18.003970 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:18.023576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:18.024800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:18.082929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1270/2570] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:18.092560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:18.094098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:18.105074 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:18.156628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997536a-7ecb-4d11-b6e1-97fef020974b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:18.160371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:18.160972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:18.161284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:18.161560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:18.171308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:18.172794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:18.182252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1301/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:18.449174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:18.450770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:18.462939 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141411-54cd-415d-b26a-a9bdd367f391 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:18.467753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:18.468392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:18.468653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:18.468936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] PATH_INFO: `/v3/projects/e37e672e72cd41a3b25334ec95c5830e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:18.470051 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37e672e72cd41a3b25334ec95c5830e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:18.472135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:18.518147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37e672e72cd41a3b25334ec95c5830e', 'request_id': 'req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.524544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37e672e72cd41a3b25334ec95c5830e', 'request_id': 'req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.532385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37e672e72cd41a3b25334ec95c5830e', 'request_id': 'req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.542536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] The token cache is being invalidate because project e37e672e72cd41a3b25334ec95c5830e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:18.542841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.543675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.546191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1271/2572] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:18 2022] DELETE /identity/v3/projects/e37e672e72cd41a3b25334ec95c5830e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:18.550349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:18.564605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8459af-9c36-4e09-abc9-f1a1e6904098 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:18.622117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:18.622969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:18.623385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:18.623747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] PATH_INFO: `/v3/users/c4176eab5457423e8e926e6569ef30c6` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:18.624950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4176eab5457423e8e926e6569ef30c6)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:18.627052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:18.674081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4176eab5457423e8e926e6569ef30c6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.674776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4176eab5457423e8e926e6569ef30c6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.686924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4176eab5457423e8e926e6569ef30c6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.694077 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4176eab5457423e8e926e6569ef30c6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.694697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f402de64-25b9-4f82-9c0d-cc69ccdcd284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4176eab5457423e8e926e6569ef30c6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:18.706626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1302/2573] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:18 2022] DELETE /identity/v3/users/c4176eab5457423e8e926e6569ef30c6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:18.980869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:18.982340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:19.005588 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e654e3-0bfa-4e43-9db6-a63dd3b3575e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.020324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:19.069387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.070059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.070343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.070620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] PATH_INFO: `/v3/projects/bbb95a9f011d4766af94a37cfbad73ab` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.071779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb95a9f011d4766af94a37cfbad73ab)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.073687 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.135955 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb95a9f011d4766af94a37cfbad73ab', 'request_id': 'req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:19.143115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb95a9f011d4766af94a37cfbad73ab', 'request_id': 'req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:19.150049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb95a9f011d4766af94a37cfbad73ab', 'request_id': 'req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:19.163352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] The token cache is being invalidate because project bbb95a9f011d4766af94a37cfbad73ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:19.163674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:19.164333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b5f2fd7e-806a-4016-a8a3-0e2bd7474111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:19.165867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1272/2574] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:18 2022] DELETE /identity/v3/projects/bbb95a9f011d4766af94a37cfbad73ab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:19.171380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cae38-2311-4629-a521-c75b0997ac58 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.172306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cae38-2311-4629-a521-c75b0997ac58 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.172587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cae38-2311-4629-a521-c75b0997ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.194216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-0b1cae38-2311-4629-a521-c75b0997ac58 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:19.195506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-0b1cae38-2311-4629-a521-c75b0997ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:19.220991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:19.259313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1303/2575] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:19.268938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739535-98c1-497b-b50d-cfd5136e9977 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.269258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739535-98c1-497b-b50d-cfd5136e9977 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.269535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739535-98c1-497b-b50d-cfd5136e9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.290038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6c739535-98c1-497b-b50d-cfd5136e9977 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:19.291306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6c739535-98c1-497b-b50d-cfd5136e9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:19.300321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1273/2576] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:19.304803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cae38-2311-4629-a521-c75b0997ac58 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.314894 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cae38-2311-4629-a521-c75b0997ac58 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.319643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.320239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.320520 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.320794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.321485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:19.321790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.323651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.337031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1304/2577] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:44:19.341290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739535-98c1-497b-b50d-cfd5136e9977 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.351533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739535-98c1-497b-b50d-cfd5136e9977 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.356327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.356954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.357238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.357514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.358148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.360686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.387373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1274/2578] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:19 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:19.391583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.402000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14801b-c352-4d0b-8361-7884d6d8724f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.459473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.460116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.460397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.460677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.461323 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.463260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.485381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1305/2579] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:19 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:19.489621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.500209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02edd6-2c6b-4651-a9ab-408148934886 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.505242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.505836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.506119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.506402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.507033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.508656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.518646 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1275/2580] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:19.522409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.532794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad6d33-5ccf-4a3a-97d7-0206a12ab5ed admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.537442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef989ea-9e79-472b-97f4-4587b291890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.538040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef989ea-9e79-472b-97f4-4587b291890e admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.538326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef989ea-9e79-472b-97f4-4587b291890e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.538603 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef989ea-9e79-472b-97f4-4587b291890e admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.539242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef989ea-9e79-472b-97f4-4587b291890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.540888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef989ea-9e79-472b-97f4-4587b291890e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.553344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1306/2581] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:19.557592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.568306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411f74-953c-4195-8917-d3bff4033377 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.572942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.573587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.573866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.574141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] PATH_INFO: `/v3/projects/34992bc274824751aa8a4fe749a09d67/users/68dc5ad3097f4e33a1a6f794617d37b0/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.589682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34992bc274824751aa8a4fe749a09d67, user_id=68dc5ad3097f4e33a1a6f794617d37b0, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.592390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.605316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1276/2582] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:19 2022] PUT /identity/v3/projects/34992bc274824751aa8a4fe749a09d67/users/68dc5ad3097f4e33a1a6f794617d37b0/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:19.616336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9127-8e55-4abf-92e6-079c1afc3876 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.616623 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9127-8e55-4abf-92e6-079c1afc3876 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.616899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9127-8e55-4abf-92e6-079c1afc3876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.645533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f22c9127-8e55-4abf-92e6-079c1afc3876 None None] MFA Rules not processed for user `68dc5ad3097f4e33a1a6f794617d37b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:19.645963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f22c9127-8e55-4abf-92e6-079c1afc3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:19.709677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1307/2583] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:19.714307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.759628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:19.776753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b722-e242-47d2-827c-7d2a96c2f03d admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.781485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.782081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.782361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.782635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.783272 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.785217 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.811193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1277/2584] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:19 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:19.816132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9127-8e55-4abf-92e6-079c1afc3876 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.826900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9127-8e55-4abf-92e6-079c1afc3876 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.846865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:19.885158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.885776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.886057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.886332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.886969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.888951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.909684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1308/2585] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:19 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:19.913894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.924711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fedc7-fa8d-47ef-b49b-81ac5dac0956 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.929352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.929943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.930224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.930500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.931136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.932909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.943866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1278/2586] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:19.947805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.957920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b6ec-f7b1-4bd1-9a32-e47e9e401856 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.962429 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff755b-d62d-4936-bc98-acff102687a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.963013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff755b-d62d-4936-bc98-acff102687a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.963291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff755b-d62d-4936-bc98-acff102687a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.963569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff755b-d62d-4936-bc98-acff102687a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:19.964228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff755b-d62d-4936-bc98-acff102687a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:19.965807 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff755b-d62d-4936-bc98-acff102687a8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:19.976187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1309/2587] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:19.980283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:19.990695 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0d751-c409-4fa6-ac91-13271bcf1803 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:19.995274 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:19.996012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:19.996296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:19.996569 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] PATH_INFO: `/v3/projects/60ee553f84dc47dcb6aa45bbb8749cde/users/3d600d6759f04f2d963603df6ad15758/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.010962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ee553f84dc47dcb6aa45bbb8749cde, user_id=3d600d6759f04f2d963603df6ad15758, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.013648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.028205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1279/2588] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:19 2022] PUT /identity/v3/projects/60ee553f84dc47dcb6aa45bbb8749cde/users/3d600d6759f04f2d963603df6ad15758/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:20.039187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.039792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.040321 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.070928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] MFA Rules not processed for user `3d600d6759f04f2d963603df6ad15758`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:20.072231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.148502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1310/2589] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:20.153049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.217477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81250a08-ef07-4b90-b4b6-61cdf4cb40e7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.222962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.223572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.223889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.224170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.224819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.226724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.258833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1280/2590] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:20 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:20.259914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.261359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.261585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.276283 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ba2db-4050-4b11-9019-0e3cc77d76b1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.336642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1a076-795b-4707-9f07-8a5d03d09d97 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.337061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.337699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.337978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.338250 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] PATH_INFO: `/v3/users/a7208e971103430bbe92093565112932` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.339376 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7208e971103430bbe92093565112932)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.341319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.341459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.342047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.342332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.343298 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.344208 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.346158 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.369073 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1281/2591] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:20 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:20.373037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.382158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:20.383954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f2122-0351-4883-91c6-eb99c56a3a9e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.388980 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.390185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.390474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.390754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.391394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.392624 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7208e971103430bbe92093565112932'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:20.393198 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.393313 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7208e971103430bbe92093565112932'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:20.395560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:20.407845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1282/2592] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:20.408195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7208e971103430bbe92093565112932'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:20.410733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.413398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.416075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7208e971103430bbe92093565112932'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:20.416790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ab0d24d1-fd52-432c-9046-f7379d1a435d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7208e971103430bbe92093565112932'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:20.426701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467b65-f56b-4fc7-b0e9-9f00c5b18dfd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.429862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1311/2593] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:20 2022] DELETE /identity/v3/users/a7208e971103430bbe92093565112932 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:20.433450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.434162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.434276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.434451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.434574 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.434788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] PATH_INFO: `/v3/projects/ccc52dd87b99462baae0cfb50920638d/users/49371bdc9dfb4f42b903765483c61cf4/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.434895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.450114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc52dd87b99462baae0cfb50920638d, user_id=49371bdc9dfb4f42b903765483c61cf4, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.454054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.456317 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:20.457524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.468732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1283/2594] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:20 2022] PUT /identity/v3/projects/ccc52dd87b99462baae0cfb50920638d/users/49371bdc9dfb4f42b903765483c61cf4/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:20.472754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.518341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1312/2595] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:20.527563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.528989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.539490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55329e-e89b-4c25-a382-bd74e832867f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.544967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.545667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.546011 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.546452 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.547143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.549097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.559624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1284/2596] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:20.563810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.573620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b42f99-c465-454e-a930-a50a61e6510c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.579894 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215507-09b9-47cb-8f2f-8551461be882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.580544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215507-09b9-47cb-8f2f-8551461be882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.580831 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215507-09b9-47cb-8f2f-8551461be882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.581110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215507-09b9-47cb-8f2f-8551461be882 admin admin] PATH_INFO: `/v3/projects/ccc52dd87b99462baae0cfb50920638d/users/49371bdc9dfb4f42b903765483c61cf4/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.583069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215507-09b9-47cb-8f2f-8551461be882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc52dd87b99462baae0cfb50920638d, user_id=49371bdc9dfb4f42b903765483c61cf4, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.585772 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215507-09b9-47cb-8f2f-8551461be882 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.592148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5660a14-97c9-4715-99ef-f0caebf68d28 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.596539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1285/2597] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:20 2022] PUT /identity/v3/projects/ccc52dd87b99462baae0cfb50920638d/users/49371bdc9dfb4f42b903765483c61cf4/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:20.611526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.611846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.612126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.640697 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] MFA Rules not processed for user `49371bdc9dfb4f42b903765483c61cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:20.641902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.642060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.642696 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.642978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.643245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.664605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:20.706683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.708341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.710858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1286/2598] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:20.719140 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1313/2599] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:44:20.723303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.724700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.772170 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:20.786349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b707a-2f63-4c70-9f22-e87ba7064681 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:20.790538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c7bcb-f84e-4cde-9a26-8be42b79037b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:20.791154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7bcb-f84e-4cde-9a26-8be42b79037b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:20.791485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7bcb-f84e-4cde-9a26-8be42b79037b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:20.791736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7bcb-f84e-4cde-9a26-8be42b79037b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:20.793755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d15c7bcb-f84e-4cde-9a26-8be42b79037b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:20.857104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c7bcb-f84e-4cde-9a26-8be42b79037b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:20.858597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c7bcb-f84e-4cde-9a26-8be42b79037b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:20.869723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1287/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:20.993864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:20.995334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:21.018569 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9818ba5-2675-4a0b-86f4-0531c4d98d06 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.023842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.024489 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.024772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.025045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] PATH_INFO: `/v3/projects/038a8e3e53704cc6815702ca9f45a3e4` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.026174 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=038a8e3e53704cc6815702ca9f45a3e4)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.028147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.078990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038a8e3e53704cc6815702ca9f45a3e4', 'request_id': 'req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:21.087013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038a8e3e53704cc6815702ca9f45a3e4', 'request_id': 'req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:21.095272 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038a8e3e53704cc6815702ca9f45a3e4', 'request_id': 'req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:21.109379 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] The token cache is being invalidate because project 038a8e3e53704cc6815702ca9f45a3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:21.109611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:21.110264 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1cc209ad-6861-4ea2-a7b0-9bf3b104d06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:21.112608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1314/2601] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:20 2022] DELETE /identity/v3/projects/038a8e3e53704cc6815702ca9f45a3e4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:21.117815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408575e-77c4-4163-98a9-fb5e39483fb2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.118114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408575e-77c4-4163-98a9-fb5e39483fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.118545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408575e-77c4-4163-98a9-fb5e39483fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.147514 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0408575e-77c4-4163-98a9-fb5e39483fb2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:21.149450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0408575e-77c4-4163-98a9-fb5e39483fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:21.223511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1288/2602] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:21.231295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded80a-8fa3-44e9-b4d0-40274185ec52 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.231613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded80a-8fa3-44e9-b4d0-40274185ec52 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.231901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded80a-8fa3-44e9-b4d0-40274185ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.252419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d4ded80a-8fa3-44e9-b4d0-40274185ec52 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:21.253898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d4ded80a-8fa3-44e9-b4d0-40274185ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:21.262081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1315/2603] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:21.267157 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408575e-77c4-4163-98a9-fb5e39483fb2 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:21.277066 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408575e-77c4-4163-98a9-fb5e39483fb2 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.282200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.282805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.283083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.283352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.284021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:21.284323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.285928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.297385 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1289/2604] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:44:21.301724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ded80a-8fa3-44e9-b4d0-40274185ec52 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:21.311161 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ded80a-8fa3-44e9-b4d0-40274185ec52 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.316046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.316651 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.316935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.317215 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.317853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.320170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.348159 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1316/2605] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:21 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:21.352511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:21.362429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540974-0689-4544-a8d2-b0fa2040a49c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.418528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.419135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.419449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.419774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.420418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.422763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.443510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1290/2606] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:21 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:21.448040 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:21.459822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c648b-d4ce-428a-978d-6a7557e9e8fd admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.464467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.465058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.465336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.465608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.466244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.468649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.478351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1317/2607] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:21.482235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:21.492180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313eb1-d7fe-4788-b10e-427507441fef admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.496784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879a8b7-377d-471f-ae7f-3afc02d690f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.497374 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879a8b7-377d-471f-ae7f-3afc02d690f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.497657 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879a8b7-377d-471f-ae7f-3afc02d690f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.497937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879a8b7-377d-471f-ae7f-3afc02d690f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.498574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879a8b7-377d-471f-ae7f-3afc02d690f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.501008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879a8b7-377d-471f-ae7f-3afc02d690f6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.511562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1291/2608] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:21.516276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:21.526212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb94dc6-9713-4667-b875-f18bc1640d78 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.531132 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.531819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.532107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.532388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] PATH_INFO: `/v3/projects/325a125e4eba4892a05faf09704b165a/users/49d9845381d24b399738ee0c17956e81/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.548979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=325a125e4eba4892a05faf09704b165a, user_id=49d9845381d24b399738ee0c17956e81, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.551970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.565127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1318/2609] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:21 2022] PUT /identity/v3/projects/325a125e4eba4892a05faf09704b165a/users/49d9845381d24b399738ee0c17956e81/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:21.570889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.571373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.571494 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.579544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:21.592844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:21.594050 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:21.653647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1292/2610] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:21.665488 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:21.667344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:21.710555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:21.727582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558d61-f4c0-41a7-ab13-6b016ffdd21d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:21.731300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8ec9b-ba23-41ab-a004-ff4d0122808f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:21.731941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8ec9b-ba23-41ab-a004-ff4d0122808f service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:21.732223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8ec9b-ba23-41ab-a004-ff4d0122808f service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:21.732499 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8ec9b-ba23-41ab-a004-ff4d0122808f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:21.741628 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8ec9b-ba23-41ab-a004-ff4d0122808f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:21.743100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8ec9b-ba23-41ab-a004-ff4d0122808f service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:21.753204 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1319/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:22.422634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:22.424289 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:22.486210 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a20d2c-d738-4c4b-be18-e5327fd1934f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:22.489649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:22.490255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:22.490537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:22.490811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:22.492488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:22.552957 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:22.554419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:22.564284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1293/2612] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:22.657972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7ec3-39de-4b0e-b1e2-9ef20898b6c8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:22.658456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7ec3-39de-4b0e-b1e2-9ef20898b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:22.658572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7ec3-39de-4b0e-b1e2-9ef20898b6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:22.691083 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f8fe7ec3-39de-4b0e-b1e2-9ef20898b6c8 None None] MFA Rules not processed for user `49d9845381d24b399738ee0c17956e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:22.692352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f8fe7ec3-39de-4b0e-b1e2-9ef20898b6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:22.776452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1320/2613] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:22.781181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:22.793962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873739-54ed-43bd-8807-4d8af900bd19 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:22.800507 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:22.801119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:22.801399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:22.801671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:22.802767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:22.804244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:22.845245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1294/2614] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:22 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:22.846316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7ec3-39de-4b0e-b1e2-9ef20898b6c8 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:22.860249 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7ec3-39de-4b0e-b1e2-9ef20898b6c8 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:22.924575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:22.925193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:22.925476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:22.925752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:22.926396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:22.928368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:22.950802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1321/2615] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:22 2022] POST /identity/v3/users => generated 308 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:22.954730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:22.965568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f7813-69a3-44a6-abf7-beaa6aa66187 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:22.971128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:22.971935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:22.972261 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:22.972547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:22.973195 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:22.974804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:22.986925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1295/2616] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:22.991205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:23.001501 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbede75a-6092-468d-9b29-924a59f5960f admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:23.006587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:23.007229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:23.007510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:23.007862 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] PATH_INFO: `/v3/projects/54a5b46690bf4650b2227c0d0e1f5d4b/users/c66be6026bbd474d80974ce2ccd63234/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:23.022881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a5b46690bf4650b2227c0d0e1f5d4b, user_id=c66be6026bbd474d80974ce2ccd63234, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:23.025572 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:23.040193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1322/2617] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:22 2022] PUT /identity/v3/projects/54a5b46690bf4650b2227c0d0e1f5d4b/users/c66be6026bbd474d80974ce2ccd63234/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:23.044152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:23.055241 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ee119-9c11-40aa-9d5a-0c734f29ecfb admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:23.074891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:23.126192 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:23.126824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:23.127113 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:23.127946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:23.128152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:23.129972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:23.140327 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1296/2618] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:23.144424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:23.156186 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c85575-55b5-4583-8012-7be492a36fce admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:23.162881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e4bd5-cc12-4f92-975c-504eabf4dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:23.162881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e4bd5-cc12-4f92-975c-504eabf4dfa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:23.162881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e4bd5-cc12-4f92-975c-504eabf4dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:23.162881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e4bd5-cc12-4f92-975c-504eabf4dfa8 admin admin] PATH_INFO: `/v3/projects/54a5b46690bf4650b2227c0d0e1f5d4b/users/c66be6026bbd474d80974ce2ccd63234/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:23.164659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e4bd5-cc12-4f92-975c-504eabf4dfa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a5b46690bf4650b2227c0d0e1f5d4b, user_id=c66be6026bbd474d80974ce2ccd63234, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:23.167302 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e4bd5-cc12-4f92-975c-504eabf4dfa8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:23.170056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:23.179792 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1323/2619] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:23 2022] PUT /identity/v3/projects/54a5b46690bf4650b2227c0d0e1f5d4b/users/c66be6026bbd474d80974ce2ccd63234/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:23.227934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef450f17-fe24-4ea6-b930-bda1049ebf8a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:23.283466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:23.284124 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:23.284399 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:23.284681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:23.287032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:23.360429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:23.361925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:23.372493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1297/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:44:23.834128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a26b9-d93c-4cf4-9c97-e23c8ff31a53 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:23.834664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a26b9-d93c-4cf4-9c97-e23c8ff31a53 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:23.834664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a26b9-d93c-4cf4-9c97-e23c8ff31a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:23.864001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-442a26b9-d93c-4cf4-9c97-e23c8ff31a53 None None] MFA Rules not processed for user `c66be6026bbd474d80974ce2ccd63234`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:23.865453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-442a26b9-d93c-4cf4-9c97-e23c8ff31a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:23.874924 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:23.939982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1324/2621] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:24.398624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:24.400189 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:24.441567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:24.484431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e119a-2d44-4d17-b8b6-a97ff888be6d service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:24.491944 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:24.492558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:24.492836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:24.493108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:24.495461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:24.510004 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:24.514667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:24.526013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1298/2622] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:24.997113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a26b9-d93c-4cf4-9c97-e23c8ff31a53 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:25.062815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a26b9-d93c-4cf4-9c97-e23c8ff31a53 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:25.067298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:25.067950 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:25.068230 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:25.068504 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] PATH_INFO: `/v3/users/49d9845381d24b399738ee0c17956e81` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:25.069605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d9845381d24b399738ee0c17956e81)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:25.071528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:25.117567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d9845381d24b399738ee0c17956e81'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.118131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d9845381d24b399738ee0c17956e81'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.130693 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d9845381d24b399738ee0c17956e81'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.137724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d9845381d24b399738ee0c17956e81'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.138335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d9845381d24b399738ee0c17956e81'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.151219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1325/2623] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:24 2022] DELETE /identity/v3/users/49d9845381d24b399738ee0c17956e81 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:25.322663 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:25.336304 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474116b8-c573-4caf-a045-006b67a21a88 service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:25.394902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:25.395455 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:25.395771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:25.396054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] PATH_INFO: `/v3/projects/325a125e4eba4892a05faf09704b165a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:25.397172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=325a125e4eba4892a05faf09704b165a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:25.399091 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:25.445300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325a125e4eba4892a05faf09704b165a', 'request_id': 'req-82dbef80-79a1-46b7-a173-daaf2e86d9bc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.451364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325a125e4eba4892a05faf09704b165a', 'request_id': 'req-82dbef80-79a1-46b7-a173-daaf2e86d9bc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.459537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325a125e4eba4892a05faf09704b165a', 'request_id': 'req-82dbef80-79a1-46b7-a173-daaf2e86d9bc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.470099 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] The token cache is being invalidate because project 325a125e4eba4892a05faf09704b165a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:25.470391 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.471016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.472763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1299/2624] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:25 2022] DELETE /identity/v3/projects/325a125e4eba4892a05faf09704b165a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:25.476584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:25.477995 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:25.491003 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c69637-2cf7-4bdd-b8db-8db1afc9ee70 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:25.516534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:25.549921 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:25.550753 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:25.550943 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:25.551236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] PATH_INFO: `/v3/users/c66be6026bbd474d80974ce2ccd63234` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:25.552405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66be6026bbd474d80974ce2ccd63234)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:25.554343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:25.599110 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66be6026bbd474d80974ce2ccd63234'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.599787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66be6026bbd474d80974ce2ccd63234'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.611963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66be6026bbd474d80974ce2ccd63234'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.618996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66be6026bbd474d80974ce2ccd63234'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.619613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-75e559b2-a631-440f-97fc-a3e60c18baf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66be6026bbd474d80974ce2ccd63234'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.632697 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1326/2625] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:25 2022] DELETE /identity/v3/users/c66be6026bbd474d80974ce2ccd63234 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:25.802743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:25.804202 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:25.828766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbef80-79a1-46b7-a173-daaf2e86d9bc admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:25.874653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:25.890710 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:25.891345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:25.891648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:25.891926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] PATH_INFO: `/v3/projects/54a5b46690bf4650b2227c0d0e1f5d4b` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:25.893046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a5b46690bf4650b2227c0d0e1f5d4b)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:25.895002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:25.946828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a5b46690bf4650b2227c0d0e1f5d4b', 'request_id': 'req-89894a2e-98ab-4d39-babe-d733f4779b00'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.953740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a5b46690bf4650b2227c0d0e1f5d4b', 'request_id': 'req-89894a2e-98ab-4d39-babe-d733f4779b00'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.961016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a5b46690bf4650b2227c0d0e1f5d4b', 'request_id': 'req-89894a2e-98ab-4d39-babe-d733f4779b00'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.972524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] The token cache is being invalidate because project 54a5b46690bf4650b2227c0d0e1f5d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:25.972820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.973463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-89894a2e-98ab-4d39-babe-d733f4779b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:25.974945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1300/2626] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:25 2022] DELETE /identity/v3/projects/54a5b46690bf4650b2227c0d0e1f5d4b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:25.979897 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ca3c-ed93-4e74-9ae1-aa9217fc2c39 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:25.980104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ca3c-ed93-4e74-9ae1-aa9217fc2c39 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:25.980600 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ca3c-ed93-4e74-9ae1-aa9217fc2c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.001910 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a6f2ca3c-ed93-4e74-9ae1-aa9217fc2c39 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:26.003151 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a6f2ca3c-ed93-4e74-9ae1-aa9217fc2c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:26.065252 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1327/2627] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:26.072857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a44fc-0be1-4e48-8494-4c72ccc60b75 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.073145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a44fc-0be1-4e48-8494-4c72ccc60b75 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.073418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a44fc-0be1-4e48-8494-4c72ccc60b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.093962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-ba9a44fc-0be1-4e48-8494-4c72ccc60b75 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:26.095310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ba9a44fc-0be1-4e48-8494-4c72ccc60b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:26.103473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1301/2628] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:26.107739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ca3c-ed93-4e74-9ae1-aa9217fc2c39 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.118893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2ca3c-ed93-4e74-9ae1-aa9217fc2c39 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.125708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.126325 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.126607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.126882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.127537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:26.127994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.129937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.142594 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1328/2629] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:44:26.146971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a44fc-0be1-4e48-8494-4c72ccc60b75 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.157571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a44fc-0be1-4e48-8494-4c72ccc60b75 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.163122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.164457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.164867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.165006 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.165855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.167819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.197375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1302/2630] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:26 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:26.201383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.219785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08b72a-2bc3-43ff-93de-aa135eb29b93 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.242747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:26.272156 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.272764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.273047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.273324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.274098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.276137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.298142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1329/2631] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:26 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:26.302566 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.313480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd9c0-60c2-42e8-928e-18364c39e4ef admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.318146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.318744 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.319026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.319302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.319982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.321572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.332235 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1303/2632] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:26.336178 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.346813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b6d9-c03b-428e-8212-389e67b4d304 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.351672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0183223-42d6-4bbf-bb3c-99ae3b2021b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.352301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0183223-42d6-4bbf-bb3c-99ae3b2021b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.352584 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0183223-42d6-4bbf-bb3c-99ae3b2021b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.352858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0183223-42d6-4bbf-bb3c-99ae3b2021b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.353503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0183223-42d6-4bbf-bb3c-99ae3b2021b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.355136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0183223-42d6-4bbf-bb3c-99ae3b2021b2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.367911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1330/2633] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:26.372433 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.383320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935420f-269e-44b9-9e8a-b0fa30309fb1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.387986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.388632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.388919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.389201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] PATH_INFO: `/v3/projects/0adc36e37dbc48108d2ff18390ae8a22/users/d40bd9a0bfd24c6f8f1b96f8abee4af0/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.403458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0adc36e37dbc48108d2ff18390ae8a22, user_id=d40bd9a0bfd24c6f8f1b96f8abee4af0, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.406451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.419018 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1304/2634] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:26 2022] PUT /identity/v3/projects/0adc36e37dbc48108d2ff18390ae8a22/users/d40bd9a0bfd24c6f8f1b96f8abee4af0/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:26.430436 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcc7bd-b592-4c03-bb11-add12e752256 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.430730 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcc7bd-b592-4c03-bb11-add12e752256 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.431004 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcc7bd-b592-4c03-bb11-add12e752256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.459316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f0dcc7bd-b592-4c03-bb11-add12e752256 None None] MFA Rules not processed for user `d40bd9a0bfd24c6f8f1b96f8abee4af0`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:26.460699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f0dcc7bd-b592-4c03-bb11-add12e752256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:26.525432 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1331/2635] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:26.529900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.600133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f76de-a19c-4ecc-bc6d-12346d8c270f admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.608856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.609783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.610077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.610358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.611016 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.612972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.635407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:26.642605 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1305/2636] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:26 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:26.646762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcc7bd-b592-4c03-bb11-add12e752256 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.657692 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcc7bd-b592-4c03-bb11-add12e752256 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.713698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.714242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.714524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.714796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.715439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.717937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.741210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1332/2637] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:26 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:26.745141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.755850 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06040ca-c567-4ea6-9f5b-58440be2a586 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.760776 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.761375 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.761660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.761940 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.762599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.764255 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.774675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1306/2638] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:26.778837 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.789564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84028167-f545-4ebc-90aa-8cc2f3b3fff5 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.794195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.794844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.795129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.795446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] PATH_INFO: `/v3/projects/bd8702ac03d845968f0aa1fc7612e27e/users/eb723a6b864b498caf96d40a7f6724d4/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.810669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8702ac03d845968f0aa1fc7612e27e, user_id=eb723a6b864b498caf96d40a7f6724d4, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.813380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.826155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1333/2639] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:26 2022] PUT /identity/v3/projects/bd8702ac03d845968f0aa1fc7612e27e/users/eb723a6b864b498caf96d40a7f6724d4/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:26.830215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.840094 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ebb6a-c81b-416e-8e3f-cc234196c00a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.896920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfda55-32f4-440b-bb01-5ebe87ac09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.897521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfda55-32f4-440b-bb01-5ebe87ac09a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.897802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfda55-32f4-440b-bb01-5ebe87ac09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.898075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfda55-32f4-440b-bb01-5ebe87ac09a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.898711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfda55-32f4-440b-bb01-5ebe87ac09a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.900351 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfda55-32f4-440b-bb01-5ebe87ac09a6 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.910492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1307/2640] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:26.914604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:26.925534 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251dfea-d1fe-4db4-bfa4-f1177d507bf1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:26.930135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:26.930780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.931065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.931343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] PATH_INFO: `/v3/projects/bd8702ac03d845968f0aa1fc7612e27e/users/eb723a6b864b498caf96d40a7f6724d4/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.933290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8702ac03d845968f0aa1fc7612e27e, user_id=eb723a6b864b498caf96d40a7f6724d4, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:26.935970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:26.938233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:26.947764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1334/2641] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:26 2022] PUT /identity/v3/projects/bd8702ac03d845968f0aa1fc7612e27e/users/eb723a6b864b498caf96d40a7f6724d4/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:26.958923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692edcbf-d19e-4d4b-a29e-3c74b9793104 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:26.959211 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692edcbf-d19e-4d4b-a29e-3c74b9793104 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:26.959489 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692edcbf-d19e-4d4b-a29e-3c74b9793104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:26.988465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-692edcbf-d19e-4d4b-a29e-3c74b9793104 None None] MFA Rules not processed for user `eb723a6b864b498caf96d40a7f6724d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:26.989598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-692edcbf-d19e-4d4b-a29e-3c74b9793104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:27.056895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1308/2642] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:27.068568 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:27.070377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:27.132012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243363-ed11-44e2-b4a9-585713d5f4e3 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:27.135702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:27.136308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:27.136593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:27.136870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:27.145841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:27.147284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:27.156690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1335/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:27.186815 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692edcbf-d19e-4d4b-a29e-3c74b9793104 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:27.251510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692edcbf-d19e-4d4b-a29e-3c74b9793104 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:27.256621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:27.257267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:27.257556 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:27.257835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] PATH_INFO: `/v3/users/d40bd9a0bfd24c6f8f1b96f8abee4af0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:27.259164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40bd9a0bfd24c6f8f1b96f8abee4af0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:27.261260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:27.272771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=100 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:27.296538 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:27.298605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:27.313121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b1afc-313a-4f56-88ca-d0a850290108 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:27.313658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40bd9a0bfd24c6f8f1b96f8abee4af0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.314394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40bd9a0bfd24c6f8f1b96f8abee4af0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.315110 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40bd9a0bfd24c6f8f1b96f8abee4af0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.317882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:27.318510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:27.318902 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:27.319185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] PATH_INFO: `/v3/users/68dc5ad3097f4e33a1a6f794617d37b0` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:27.320355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68dc5ad3097f4e33a1a6f794617d37b0)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:27.322289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:27.322538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40bd9a0bfd24c6f8f1b96f8abee4af0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.334811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-a6fc0b3a-9041-4954-995e-29fadc60f2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40bd9a0bfd24c6f8f1b96f8abee4af0'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.348721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1309/2644] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:27 2022] DELETE /identity/v3/users/d40bd9a0bfd24c6f8f1b96f8abee4af0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:27.353443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039408d8-db21-465a-8465-432ca65ee43e None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:27.353766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039408d8-db21-465a-8465-432ca65ee43e None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:27.354065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039408d8-db21-465a-8465-432ca65ee43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:27.371838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68dc5ad3097f4e33a1a6f794617d37b0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.372518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68dc5ad3097f4e33a1a6f794617d37b0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.374945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-039408d8-db21-465a-8465-432ca65ee43e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:27.376199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-039408d8-db21-465a-8465-432ca65ee43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:27.385843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68dc5ad3097f4e33a1a6f794617d37b0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.393702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68dc5ad3097f4e33a1a6f794617d37b0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.394344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ac3780cf-b53a-4c69-97ca-1940803c179d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68dc5ad3097f4e33a1a6f794617d37b0'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:27.406749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1336/2645] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:27 2022] DELETE /identity/v3/users/68dc5ad3097f4e33a1a6f794617d37b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:27.410778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852f88-964b-4a57-bf3e-49475d52f758 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:27.411068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852f88-964b-4a57-bf3e-49475d52f758 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:27.411346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852f88-964b-4a57-bf3e-49475d52f758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:27.430744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-96852f88-964b-4a57-bf3e-49475d52f758 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:27.431994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-96852f88-964b-4a57-bf3e-49475d52f758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:27.441014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1310/2646] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:27.450739 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039408d8-db21-465a-8465-432ca65ee43e None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:27.452171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-039408d8-db21-465a-8465-432ca65ee43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:27.495037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1337/2647] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:27.505297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96852f88-964b-4a57-bf3e-49475d52f758 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:27.511638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039408d8-db21-465a-8465-432ca65ee43e None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:27.515289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:27.557732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:27.564500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96852f88-964b-4a57-bf3e-49475d52f758 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:27.568245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:27.568739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:27.568871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:27.569128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:27.569405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:27.569611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:27.569964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:27.570309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:27.578588 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:27.580063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:27.580179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:27.581578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:27.589722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1311/2648] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:44:27.594137 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1338/2649] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:44:28.040874 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:28.042487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.050808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:28.052308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.058148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38f8d1-13d8-4753-a7c1-5790edf1be6e service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:28.065735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a4ae4-227f-4ebe-bba6-5436f05b5958 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:28.069838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:28.070589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.070881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.071162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] PATH_INFO: `/v3/projects/0adc36e37dbc48108d2ff18390ae8a22` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:28.071356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:28.072235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.072354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0adc36e37dbc48108d2ff18390ae8a22)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:28.072774 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.073434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] PATH_INFO: `/v3/projects/34992bc274824751aa8a4fe749a09d67` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:28.074477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:28.074592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34992bc274824751aa8a4fe749a09d67)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:28.077247 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:28.125757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0adc36e37dbc48108d2ff18390ae8a22', 'request_id': 'req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.133037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0adc36e37dbc48108d2ff18390ae8a22', 'request_id': 'req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.141533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0adc36e37dbc48108d2ff18390ae8a22', 'request_id': 'req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.148167 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34992bc274824751aa8a4fe749a09d67', 'request_id': 'req-e2fc46e1-076e-4537-8591-726f0f8c6357'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.152333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] The token cache is being invalidate because project 0adc36e37dbc48108d2ff18390ae8a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:28.152618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.153629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.154068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34992bc274824751aa8a4fe749a09d67', 'request_id': 'req-e2fc46e1-076e-4537-8591-726f0f8c6357'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.155696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1312/2650] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:28 2022] DELETE /identity/v3/projects/0adc36e37dbc48108d2ff18390ae8a22 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:28.159527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:28.160875 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.162027 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34992bc274824751aa8a4fe749a09d67', 'request_id': 'req-e2fc46e1-076e-4537-8591-726f0f8c6357'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.175955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] The token cache is being invalidate because project 34992bc274824751aa8a4fe749a09d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:28.176244 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.176888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.178618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1339/2651] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:28 2022] DELETE /identity/v3/projects/34992bc274824751aa8a4fe749a09d67 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:28.182091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:28.183389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.228014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7df1-3f1c-4512-b7e2-1296cd54b2d8 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:28.248182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc46e1-076e-4537-8591-726f0f8c6357 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:28.253919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:28.254549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.254831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.255108 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] PATH_INFO: `/v3/users/3d600d6759f04f2d963603df6ad15758` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:28.256291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d600d6759f04f2d963603df6ad15758)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:28.258334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:28.286396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:28.286969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.287253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.287541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] PATH_INFO: `/v3/users/eb723a6b864b498caf96d40a7f6724d4` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:28.288721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb723a6b864b498caf96d40a7f6724d4)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:28.290817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:28.299111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:28.309536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d600d6759f04f2d963603df6ad15758'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.310341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d600d6759f04f2d963603df6ad15758'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.314597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:28.324240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d600d6759f04f2d963603df6ad15758'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.331711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d600d6759f04f2d963603df6ad15758'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.332380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d600d6759f04f2d963603df6ad15758'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.340905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb723a6b864b498caf96d40a7f6724d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.341693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb723a6b864b498caf96d40a7f6724d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.342854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb723a6b864b498caf96d40a7f6724d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.346451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1340/2652] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:28 2022] DELETE /identity/v3/users/3d600d6759f04f2d963603df6ad15758 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:28.349930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb723a6b864b498caf96d40a7f6724d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.363930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb723a6b864b498caf96d40a7f6724d4'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.377148 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1313/2653] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:28 2022] DELETE /identity/v3/users/eb723a6b864b498caf96d40a7f6724d4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:28.719458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:28.721013 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.731463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:28.733420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.806964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95abc2-e426-4132-a8c4-3ca33fb283f5 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:28.807437 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe085c-95ec-4d9b-aa97-b6bde7396022 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:28.811526 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:28.812142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.812420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.812522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:28.812694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] PATH_INFO: `/v3/projects/60ee553f84dc47dcb6aa45bbb8749cde` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:28.813163 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.813447 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.813724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] PATH_INFO: `/v3/projects/bd8702ac03d845968f0aa1fc7612e27e` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:28.813830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ee553f84dc47dcb6aa45bbb8749cde)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:28.814880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8702ac03d845968f0aa1fc7612e27e)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:28.815744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:28.816946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:28.863870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ee553f84dc47dcb6aa45bbb8749cde', 'request_id': 'req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.864084 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8702ac03d845968f0aa1fc7612e27e', 'request_id': 'req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.869682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ee553f84dc47dcb6aa45bbb8749cde', 'request_id': 'req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.870036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8702ac03d845968f0aa1fc7612e27e', 'request_id': 'req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.876729 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ee553f84dc47dcb6aa45bbb8749cde', 'request_id': 'req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.882555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8702ac03d845968f0aa1fc7612e27e', 'request_id': 'req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.894192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] The token cache is being invalidate because project 60ee553f84dc47dcb6aa45bbb8749cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:28.894618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.895364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.896966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1341/2654] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:28 2022] DELETE /identity/v3/projects/60ee553f84dc47dcb6aa45bbb8749cde => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:28.897086 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] The token cache is being invalidate because project bd8702ac03d845968f0aa1fc7612e27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:28.897328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.898076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-e7e020a7-66f5-49a1-9ad3-8e8e7716be99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:28.902761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1314/2655] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:28 2022] DELETE /identity/v3/projects/bd8702ac03d845968f0aa1fc7612e27e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:28.902899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:28.902899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.904054 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2fdf3-e0b0-4e7c-8751-c061a30bd0a2 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.904370 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2fdf3-e0b0-4e7c-8751-c061a30bd0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.904648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2fdf3-e0b0-4e7c-8751-c061a30bd0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:28.925175 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-e8e2fdf3-e0b0-4e7c-8751-c061a30bd0a2 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:28.926389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e8e2fdf3-e0b0-4e7c-8751-c061a30bd0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:28.946583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:28.948936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:28.979881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4417a5-1ffe-4ee6-ae57-688cd15a2e56 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:28.990026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1315/2656] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:28.997807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3153-a96b-4eaa-8009-409ea0b1adac None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:28.998166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3153-a96b-4eaa-8009-409ea0b1adac None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:28.999638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3153-a96b-4eaa-8009-409ea0b1adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.020070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-cf2e3153-a96b-4eaa-8009-409ea0b1adac None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:29.021670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-cf2e3153-a96b-4eaa-8009-409ea0b1adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.030204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1316/2657] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:29.034269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e3153-a96b-4eaa-8009-409ea0b1adac None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.037124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.037766 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.038048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.038324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] PATH_INFO: `/v3/users/49371bdc9dfb4f42b903765483c61cf4` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.039462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49371bdc9dfb4f42b903765483c61cf4)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.041445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.044277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e3153-a96b-4eaa-8009-409ea0b1adac None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.049194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.049896 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.050184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.050461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.051112 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:29.051418 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.053161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.065746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1317/2658] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:44:29.070165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.081555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d138a-a1d1-4a81-869c-23aebbf390a5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.091250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.091883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.092190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.092440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.093208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49371bdc9dfb4f42b903765483c61cf4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.093780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.094298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49371bdc9dfb4f42b903765483c61cf4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.095406 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.107511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49371bdc9dfb4f42b903765483c61cf4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.116400 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49371bdc9dfb4f42b903765483c61cf4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.117409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49371bdc9dfb4f42b903765483c61cf4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.122595 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1318/2659] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:29.127466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.130222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.136326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1342/2660] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:28 2022] DELETE /identity/v3/users/49371bdc9dfb4f42b903765483c61cf4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:29.195213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8233-fb19-46c5-91dc-89caeb96b1d4 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.257865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.258477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.258760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.259033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.259723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.261927 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.285847 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1319/2661] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:29.296918 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.308042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ee738-5fd3-4ff4-b3dd-e1de17985ec7 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.313637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.314227 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.314506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.314779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.315420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.317124 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.328419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1343/2662] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:29.332395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.343440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f7fe2-b185-4673-9d88-c4591030f36e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.348169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd81a-d811-49b4-8cdb-d89419b21e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.348767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd81a-d811-49b4-8cdb-d89419b21e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.349048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd81a-d811-49b4-8cdb-d89419b21e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.349318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd81a-d811-49b4-8cdb-d89419b21e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.349965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afd81a-d811-49b4-8cdb-d89419b21e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.351553 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afd81a-d811-49b4-8cdb-d89419b21e47 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.362401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1320/2663] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:29.366743 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.377394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddce8f-830e-4d79-8070-9be6820d20a6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.385434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.385434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.385434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.385434 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] PATH_INFO: `/v3/projects/658562b00490452ab72de70581b85da0/users/476c622ad0b840edb877837ffb23c604/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.399645 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658562b00490452ab72de70581b85da0, user_id=476c622ad0b840edb877837ffb23c604, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.402581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.417360 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1344/2664] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:29 2022] PUT /identity/v3/projects/658562b00490452ab72de70581b85da0/users/476c622ad0b840edb877837ffb23c604/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:29.432015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda9f8-98ce-4ff4-9a4f-8ef3d0f03bb3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.432311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda9f8-98ce-4ff4-9a4f-8ef3d0f03bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.432622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.432770 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda9f8-98ce-4ff4-9a4f-8ef3d0f03bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.434361 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.455713 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:29.465762 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-acdda9f8-98ce-4ff4-9a4f-8ef3d0f03bb3 None None] MFA Rules not processed for user `476c622ad0b840edb877837ffb23c604`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:29.468228 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-acdda9f8-98ce-4ff4-9a4f-8ef3d0f03bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.477482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:29.504126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11d866-4b33-4af6-a90c-1397bedee9e2 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.509002 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.509698 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.509984 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.510268 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] PATH_INFO: `/v3/projects/ccc52dd87b99462baae0cfb50920638d` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.511405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc52dd87b99462baae0cfb50920638d)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.513401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.537721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1321/2665] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:29.542059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda9f8-98ce-4ff4-9a4f-8ef3d0f03bb3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.557523 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda9f8-98ce-4ff4-9a4f-8ef3d0f03bb3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.568937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc52dd87b99462baae0cfb50920638d', 'request_id': 'req-03953f69-0a3a-4beb-b8b4-99f53d1ba224'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.574392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc52dd87b99462baae0cfb50920638d', 'request_id': 'req-03953f69-0a3a-4beb-b8b4-99f53d1ba224'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.581046 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc52dd87b99462baae0cfb50920638d', 'request_id': 'req-03953f69-0a3a-4beb-b8b4-99f53d1ba224'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.595228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] The token cache is being invalidate because project ccc52dd87b99462baae0cfb50920638d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:29.595518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.596200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-03953f69-0a3a-4beb-b8b4-99f53d1ba224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:29.598233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1345/2666] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:29 2022] DELETE /identity/v3/projects/ccc52dd87b99462baae0cfb50920638d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:29.602795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7409f16-4d44-4af9-bc95-6ba0cfa2dd89 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.603080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7409f16-4d44-4af9-bc95-6ba0cfa2dd89 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.603357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7409f16-4d44-4af9-bc95-6ba0cfa2dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.616862 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.617478 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.617792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.618067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.618708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.620751 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.622992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e7409f16-4d44-4af9-bc95-6ba0cfa2dd89 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:29.624303 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e7409f16-4d44-4af9-bc95-6ba0cfa2dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.633015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1346/2667] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:29.641787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5043e-10f3-4f14-8990-251cebd57564 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.642307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5043e-10f3-4f14-8990-251cebd57564 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.642741 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5043e-10f3-4f14-8990-251cebd57564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.651109 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1322/2668] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:29.652104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.653929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.663409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-80e5043e-10f3-4f14-8990-251cebd57564 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:29.664613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-80e5043e-10f3-4f14-8990-251cebd57564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.719868 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea2d7-7bd5-4fec-9898-3cecd72c9783 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.725095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1347/2669] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:29.725742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.726371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.726655 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.726931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.727564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.728849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5043e-10f3-4f14-8990-251cebd57564 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.729765 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.737886 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5043e-10f3-4f14-8990-251cebd57564 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.742941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.743613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.743962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.744306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.745008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:29.745370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.747129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.753401 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1323/2670] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:29.757902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.760367 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1348/2671] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:44:29.764923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.768854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426cf6e-25e7-48e7-9616-d06b08c0fab3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.773724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.774331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.774617 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.774718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04bcb-3276-4b45-82d9-15f764414596 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.774897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.775540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.777203 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.779464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.780626 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.780891 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.781170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.781795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.783714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.788396 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1324/2672] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:29.792468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.799461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:29.803771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f06315-4723-4bb4-b839-31555dd9d27b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.809675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.810273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.810558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.810835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.811533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.813165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.813311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1349/2673] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:29.817579 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.829662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1325/2674] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:29.831042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.840696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8569-07c2-40bf-9469-e2b53ff3f718 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.844784 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:29.883735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec39b2-3085-4a0b-88a4-d23953aab503 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.888408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.889026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.889648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.889979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.890613 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.892575 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.900667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddf701-9931-4631-b135-d29fbc75f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.901361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf701-9931-4631-b135-d29fbc75f7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.901641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf701-9931-4631-b135-d29fbc75f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.901915 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf701-9931-4631-b135-d29fbc75f7f7 admin admin] PATH_INFO: `/v3/projects/6acb896615fb4a5fa2c3cd635cd705cb/users/f52d15ef25a34ea398ebf2dd1bb85496/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.914273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1350/2675] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:29.917472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddf701-9931-4631-b135-d29fbc75f7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acb896615fb4a5fa2c3cd635cd705cb, user_id=f52d15ef25a34ea398ebf2dd1bb85496, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.918378 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:29.920193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddf701-9931-4631-b135-d29fbc75f7f7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:29.929481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8066bf5-5d7c-418f-8df4-cda67eaea106 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:29.933708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1326/2676] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:29 2022] PUT /identity/v3/projects/6acb896615fb4a5fa2c3cd635cd705cb/users/f52d15ef25a34ea398ebf2dd1bb85496/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:29.943908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d4378-87a4-4aad-8f85-26f5f959a943 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.944193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d4378-87a4-4aad-8f85-26f5f959a943 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.944466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d4378-87a4-4aad-8f85-26f5f959a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.972535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-698d4378-87a4-4aad-8f85-26f5f959a943 None None] MFA Rules not processed for user `f52d15ef25a34ea398ebf2dd1bb85496`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:29.973792 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-698d4378-87a4-4aad-8f85-26f5f959a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:29.987036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:29.987941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:29.988329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:29.988608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:29.989258 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:29.990919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.001681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1351/2677] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:30.005798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.016288 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7304c-e7d1-42a4-a8b4-5c2c5e722fc8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.021368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.021945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.022222 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.022500 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.023127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.024739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.035849 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1352/2678] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:30.039705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1327/2679] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:30.040128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.043900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d4378-87a4-4aad-8f85-26f5f959a943 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.050644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfbe87-729f-4a14-8783-34593d89ec9d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.054905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d4378-87a4-4aad-8f85-26f5f959a943 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.055235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f457b-16b9-4d81-bc72-8a4a2a7a91f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.055906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f457b-16b9-4d81-bc72-8a4a2a7a91f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.056189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f457b-16b9-4d81-bc72-8a4a2a7a91f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.056466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f457b-16b9-4d81-bc72-8a4a2a7a91f3 admin admin] PATH_INFO: `/v3/projects/41ac4607c48d40fd84baf2d53a0b1f46/users/bc308e1725504b9893aa9bdea4c59bbf/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.059540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.060154 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.060435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.060707 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.061648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.063612 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.071155 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f457b-16b9-4d81-bc72-8a4a2a7a91f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ac4607c48d40fd84baf2d53a0b1f46, user_id=bc308e1725504b9893aa9bdea4c59bbf, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.073881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f457b-16b9-4d81-bc72-8a4a2a7a91f3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.087079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1353/2680] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:30 2022] PUT /identity/v3/projects/41ac4607c48d40fd84baf2d53a0b1f46/users/bc308e1725504b9893aa9bdea4c59bbf/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:30.092789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.093081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.093411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.098576 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1328/2681] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:30 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:30.099463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.114884 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:30.116123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:30.157136 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:30.175072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b4ca-4c6f-4148-acda-c4ceee47bb95 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.178355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1354/2682] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:44:30.179774 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.180388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.180673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.180951 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.181592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.183564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.188654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.190044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:30.207642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1329/2683] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:30 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:30.209519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:30.212325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.224145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d78cd4-9830-4256-ac59-c4854a4dcd5b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.229141 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.229747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.230030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.230301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.230942 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.232689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.245796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1330/2684] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:30.246736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.255384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314e779-3e18-464d-a901-f6e6b9969111 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.257552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817dd83-c5cd-499c-92e5-4c4c82b21617 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.259036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.259658 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.259958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.260231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.262462 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.263123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.263397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.263715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] PATH_INFO: `/v3/projects/2697431a44b4409d98cccf1f990b573c/users/cf7bce085dce441d8eb45ceb40caa847/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.271864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.273812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.279063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2697431a44b4409d98cccf1f990b573c, user_id=cf7bce085dce441d8eb45ceb40caa847, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.282368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.284306 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1355/2685] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:44:30.295641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1331/2686] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:30 2022] PUT /identity/v3/projects/2697431a44b4409d98cccf1f990b573c/users/cf7bce085dce441d8eb45ceb40caa847/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:30.299865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.310100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade55535-8ec8-49f5-bb9c-ff93010a79fc service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.374906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05749a-7aeb-4993-9ddd-8c9e24dc276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.375566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05749a-7aeb-4993-9ddd-8c9e24dc276a admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.375878 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05749a-7aeb-4993-9ddd-8c9e24dc276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.376150 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05749a-7aeb-4993-9ddd-8c9e24dc276a admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.376793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05749a-7aeb-4993-9ddd-8c9e24dc276a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.378420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05749a-7aeb-4993-9ddd-8c9e24dc276a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.388606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1356/2687] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:44:30.393205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.403339 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff106-4b0c-44ee-96e7-b7e76eb6993c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.408681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.409332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.409610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.409882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] PATH_INFO: `/v3/projects/2697431a44b4409d98cccf1f990b573c/users/cf7bce085dce441d8eb45ceb40caa847/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.411864 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2697431a44b4409d98cccf1f990b573c, user_id=cf7bce085dce441d8eb45ceb40caa847, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.414512 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.426034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1332/2688] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:30 2022] PUT /identity/v3/projects/2697431a44b4409d98cccf1f990b573c/users/cf7bce085dce441d8eb45ceb40caa847/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:30.437377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1993044-249d-4189-8d49-78659da5fd28 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.437670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1993044-249d-4189-8d49-78659da5fd28 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.437954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1993044-249d-4189-8d49-78659da5fd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.469537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-b1993044-249d-4189-8d49-78659da5fd28 None None] MFA Rules not processed for user `cf7bce085dce441d8eb45ceb40caa847`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:30.470937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b1993044-249d-4189-8d49-78659da5fd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:30.551706 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1357/2689] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:30.564998 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:30.567072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:30.649935 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299f103-9147-474f-8af8-82dc1156ce0e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:30.656443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:30.657419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.657711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.657990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:30.670011 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:30.672930 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:30.691135 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1333/2690] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:30.966737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:30.967261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:30.967740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:31.002007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] MFA Rules not processed for user `bc308e1725504b9893aa9bdea4c59bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:31.003391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:31.041913 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:31.089020 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1358/2691] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:31.101730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:31.111365 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce942c44-b30c-47bb-98cd-01b3dc242bfa service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:31.115014 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc76db-a9c0-4c99-873e-e1d617eab063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:31.115671 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc76db-a9c0-4c99-873e-e1d617eab063 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:31.116031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc76db-a9c0-4c99-873e-e1d617eab063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:31.125090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc76db-a9c0-4c99-873e-e1d617eab063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:31.134835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc76db-a9c0-4c99-873e-e1d617eab063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:31.136310 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc76db-a9c0-4c99-873e-e1d617eab063 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:31.146734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1334/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:31.277567 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:31.279001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:31.292866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938a730-8d00-46e8-a1ff-f8398085a38a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:31.297102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:31.297775 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:31.298054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:31.298326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:31.300717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:31.363804 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:31.365593 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:31.375118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1359/2693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:32.518393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ec9c2-d652-44bb-a96c-f2d88d19b63b None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:32.518902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ec9c2-d652-44bb-a96c-f2d88d19b63b None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:32.518996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ec9c2-d652-44bb-a96c-f2d88d19b63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:32.538505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-080ec9c2-d652-44bb-a96c-f2d88d19b63b None None] MFA Rules not processed for user `bc308e1725504b9893aa9bdea4c59bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:32.539708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-080ec9c2-d652-44bb-a96c-f2d88d19b63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:32.546620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1335/2694] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:32.790880 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:32.792461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:32.851634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71574-f82e-44dc-8844-a41ba3e62145 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:32.855311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:32.855952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:32.856232 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:32.856506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:32.858209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:32.868485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:32.870209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:32.879453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1360/2695] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:35.438215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ec9c2-d652-44bb-a96c-f2d88d19b63b None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:35.449742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ec9c2-d652-44bb-a96c-f2d88d19b63b None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:35.454162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca58f89-5f9f-4be2-8139-1e7ae1c9777b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:35.454931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca58f89-5f9f-4be2-8139-1e7ae1c9777b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:35.455212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca58f89-5f9f-4be2-8139-1e7ae1c9777b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:35.455485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca58f89-5f9f-4be2-8139-1e7ae1c9777b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:35.518282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca58f89-5f9f-4be2-8139-1e7ae1c9777b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:35.520224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca58f89-5f9f-4be2-8139-1e7ae1c9777b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:35.529801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1336/2696] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:37.685454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:37.748097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cf3a-2803-4513-bef1-fd0e08b65dfa service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:37.753739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:37.754384 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:37.754662 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:37.754936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] PATH_INFO: `/v3/users/476c622ad0b840edb877837ffb23c604` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:37.756088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=476c622ad0b840edb877837ffb23c604)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:37.758044 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:37.770586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:37.805615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476c622ad0b840edb877837ffb23c604'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:37.806255 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476c622ad0b840edb877837ffb23c604'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:37.818733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476c622ad0b840edb877837ffb23c604'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:37.829135 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476c622ad0b840edb877837ffb23c604'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:37.829978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476c622ad0b840edb877837ffb23c604'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:37.844427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1361/2697] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:37 2022] DELETE /identity/v3/users/476c622ad0b840edb877837ffb23c604 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:37.848931 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:37.849378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:37.849499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:37.864465 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:37.873492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:37.875704 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:37.944782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1337/2698] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:37.954644 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:37.956118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:38.022877 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a299c1e-dd3d-472b-9e42-280b99dc86fd admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:38.026758 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:38.027368 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:38.027675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:38.027957 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:38.040394 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:38.041857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:38.052532 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1362/2699] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:38.319979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:38.321444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:38.334008 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a96635-0658-42ec-8bf5-725b5b9b3837 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:38.338624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:38.339260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:38.339542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:38.339883 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] PATH_INFO: `/v3/projects/658562b00490452ab72de70581b85da0` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:38.341017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=658562b00490452ab72de70581b85da0)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:38.344111 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:38.401686 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658562b00490452ab72de70581b85da0', 'request_id': 'req-74adc3be-4e34-49e7-84da-ad40068e23ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.409453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658562b00490452ab72de70581b85da0', 'request_id': 'req-74adc3be-4e34-49e7-84da-ad40068e23ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.418543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658562b00490452ab72de70581b85da0', 'request_id': 'req-74adc3be-4e34-49e7-84da-ad40068e23ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.430424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] The token cache is being invalidate because project 658562b00490452ab72de70581b85da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:38.430742 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.431425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.435824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1338/2700] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:38 2022] DELETE /identity/v3/projects/658562b00490452ab72de70581b85da0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:38.437419 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:38.447776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ddb3-ca1c-4e46-ad14-a61c0e6ccb2f service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:38.514064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:38.515887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:38.516180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:38.516459 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] PATH_INFO: `/v3/users/f52d15ef25a34ea398ebf2dd1bb85496` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:38.517715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52d15ef25a34ea398ebf2dd1bb85496)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:38.519866 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:38.558806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:38.569334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52d15ef25a34ea398ebf2dd1bb85496'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.570312 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52d15ef25a34ea398ebf2dd1bb85496'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.582843 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52d15ef25a34ea398ebf2dd1bb85496'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.590406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52d15ef25a34ea398ebf2dd1bb85496'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.591011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52d15ef25a34ea398ebf2dd1bb85496'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:38.603631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1363/2701] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:38 2022] DELETE /identity/v3/users/f52d15ef25a34ea398ebf2dd1bb85496 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:38.877166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:38.882636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:38.897867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc3be-4e34-49e7-84da-ad40068e23ff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:38.954969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:38.955533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:38.956986 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:38.957278 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] PATH_INFO: `/v3/projects/6acb896615fb4a5fa2c3cd635cd705cb` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:38.958449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6acb896615fb4a5fa2c3cd635cd705cb)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:38.960544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:38.995466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:39.008749 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6acb896615fb4a5fa2c3cd635cd705cb', 'request_id': 'req-8a83ad25-37d5-4d97-8ec4-dee43b183094'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.014769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6acb896615fb4a5fa2c3cd635cd705cb', 'request_id': 'req-8a83ad25-37d5-4d97-8ec4-dee43b183094'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.022581 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6acb896615fb4a5fa2c3cd635cd705cb', 'request_id': 'req-8a83ad25-37d5-4d97-8ec4-dee43b183094'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.034471 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] The token cache is being invalidate because project 6acb896615fb4a5fa2c3cd635cd705cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:39.034755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.035420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.037017 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1339/2702] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:38 2022] DELETE /identity/v3/projects/6acb896615fb4a5fa2c3cd635cd705cb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:44:39.041145 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:39.042625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:39.056076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfbfc-60ed-4a12-9b8b-03ad45396646 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:39.121711 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:39.122353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:39.122634 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:39.122908 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] PATH_INFO: `/v3/users/cf7bce085dce441d8eb45ceb40caa847` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:39.125519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7bce085dce441d8eb45ceb40caa847)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:39.127476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:39.178625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7bce085dce441d8eb45ceb40caa847'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.179566 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7bce085dce441d8eb45ceb40caa847'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.192713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7bce085dce441d8eb45ceb40caa847'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.200740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7bce085dce441d8eb45ceb40caa847'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.201431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c648c57d-c726-4aa3-ba7e-fd1db95c19a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7bce085dce441d8eb45ceb40caa847'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.214371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1364/2703] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:39 2022] DELETE /identity/v3/users/cf7bce085dce441d8eb45ceb40caa847 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:39.486080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:39.487572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:39.507046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83ad25-37d5-4d97-8ec4-dee43b183094 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:39.568440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:39.569104 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:39.569387 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:39.569662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] PATH_INFO: `/v3/projects/2697431a44b4409d98cccf1f990b573c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:39.570769 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2697431a44b4409d98cccf1f990b573c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:39.572746 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:39.619718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2697431a44b4409d98cccf1f990b573c', 'request_id': 'req-8cccc5a1-e6ed-4994-b630-cd5176c637b9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.626554 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2697431a44b4409d98cccf1f990b573c', 'request_id': 'req-8cccc5a1-e6ed-4994-b630-cd5176c637b9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.635036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2697431a44b4409d98cccf1f990b573c', 'request_id': 'req-8cccc5a1-e6ed-4994-b630-cd5176c637b9'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.646403 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] The token cache is being invalidate because project 2697431a44b4409d98cccf1f990b573c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:39.646685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.647346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-8cccc5a1-e6ed-4994-b630-cd5176c637b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:39.648871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1340/2704] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:39 2022] DELETE /identity/v3/projects/2697431a44b4409d98cccf1f990b573c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:39.655844 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369630-cc86-4dc4-970a-2e1ef0f3ae6b None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:39.656123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369630-cc86-4dc4-970a-2e1ef0f3ae6b None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:39.656397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369630-cc86-4dc4-970a-2e1ef0f3ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:39.675769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f5369630-cc86-4dc4-970a-2e1ef0f3ae6b None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:39.676952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f5369630-cc86-4dc4-970a-2e1ef0f3ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:39.703853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:39.738671 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1365/2705] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:39.802668 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283758-40b3-4023-82e0-dcd8b62a944d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:39.802959 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283758-40b3-4023-82e0-dcd8b62a944d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:39.803242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283758-40b3-4023-82e0-dcd8b62a944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:39.825057 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-d1283758-40b3-4023-82e0-dcd8b62a944d None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:39.826271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-d1283758-40b3-4023-82e0-dcd8b62a944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:39.834813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1341/2706] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:39.839233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369630-cc86-4dc4-970a-2e1ef0f3ae6b None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:39.849701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369630-cc86-4dc4-970a-2e1ef0f3ae6b None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:39.854395 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:39.855001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:39.855282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:39.855557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:39.856224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:39.856640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:39.858256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:39.870347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1366/2707] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:44:39.875505 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283758-40b3-4023-82e0-dcd8b62a944d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:39.885251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283758-40b3-4023-82e0-dcd8b62a944d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:39.891197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:39.891981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:39.892269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:39.892550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:39.893483 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:39.895537 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:39.924470 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1342/2708] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:39 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:39.928592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:39.939462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93c755-07df-4dfd-9e99-b0173c61e226 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:40.001259 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:40.002006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:40.002391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:40.002767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:40.003791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:40.005858 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:40.029959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1367/2709] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:39 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:44:40.034058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:40.045498 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b940317-7925-485e-8e2e-163f66948562 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:40.050924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:40.051649 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:40.051936 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:40.052209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:40.052876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:40.054481 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:40.065577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1343/2710] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:40.069612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:40.080708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c24f0-1707-434e-8d30-f798f10eb74a admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:40.086397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a75182-5e58-4742-8c6f-3c3b1d9754b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:40.086811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75182-5e58-4742-8c6f-3c3b1d9754b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:40.087231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75182-5e58-4742-8c6f-3c3b1d9754b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:40.087514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a75182-5e58-4742-8c6f-3c3b1d9754b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:40.088237 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a75182-5e58-4742-8c6f-3c3b1d9754b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:40.090355 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a75182-5e58-4742-8c6f-3c3b1d9754b2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:40.106791 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1368/2711] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:40.108258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:40.118501 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267849-a6fe-41ad-9430-f2e8a942d01e admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:40.123402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:40.124331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:40.124682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:40.124961 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] PATH_INFO: `/v3/projects/43c07fd26cd74cd892a7a331a995837f/users/c9fbd493854d4da5892158384d756a98/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:40.134392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:40.143085 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c07fd26cd74cd892a7a331a995837f, user_id=c9fbd493854d4da5892158384d756a98, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:40.146222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:40.160733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1344/2712] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:40 2022] PUT /identity/v3/projects/43c07fd26cd74cd892a7a331a995837f/users/c9fbd493854d4da5892158384d756a98/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:40.172093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a55a-8113-4ff9-929a-bec09f50671d None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:40.172387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a55a-8113-4ff9-929a-bec09f50671d None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:40.172668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a55a-8113-4ff9-929a-bec09f50671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:40.206337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-ae08a55a-8113-4ff9-929a-bec09f50671d None None] MFA Rules not processed for user `c9fbd493854d4da5892158384d756a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:40.207549 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ae08a55a-8113-4ff9-929a-bec09f50671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:40.281314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1369/2713] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:40.292331 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:40.294254 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:40.353464 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb23e-2215-41ae-9b65-a2e07fc13c77 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:40.357302 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84518c20-8cff-4ea8-8372-1b5e2cd4f279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:40.358000 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84518c20-8cff-4ea8-8372-1b5e2cd4f279 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:40.358524 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84518c20-8cff-4ea8-8372-1b5e2cd4f279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:40.358736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84518c20-8cff-4ea8-8372-1b5e2cd4f279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:40.367332 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84518c20-8cff-4ea8-8372-1b5e2cd4f279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:40.368807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84518c20-8cff-4ea8-8372-1b5e2cd4f279 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:40.380394 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1345/2714] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:43.387666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a55a-8113-4ff9-929a-bec09f50671d None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:43.420812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:43.456812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a55a-8113-4ff9-929a-bec09f50671d None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:43.462036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:43.462612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:43.462901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:43.463182 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] PATH_INFO: `/v3/users/c9fbd493854d4da5892158384d756a98` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:43.464607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fbd493854d4da5892158384d756a98)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:43.466309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:43.515780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fbd493854d4da5892158384d756a98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:43.516513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fbd493854d4da5892158384d756a98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:43.528390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fbd493854d4da5892158384d756a98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:43.536454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fbd493854d4da5892158384d756a98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:43.537085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fbd493854d4da5892158384d756a98'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:43.551364 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1370/2715] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:43 2022] DELETE /identity/v3/users/c9fbd493854d4da5892158384d756a98 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:43.555841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:43.556321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:43.556450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:43.576421 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:43.577642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:43.635480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1346/2716] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:43.645616 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:43.647017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:43.704191 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3ee8-632d-4e9b-9db5-134d5172b9b7 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:43.707898 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279adf04-2ada-4d62-8a0e-8a3120b277ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:43.708499 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279adf04-2ada-4d62-8a0e-8a3120b277ee service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:43.708780 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279adf04-2ada-4d62-8a0e-8a3120b277ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:43.709057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279adf04-2ada-4d62-8a0e-8a3120b277ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:43.717973 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279adf04-2ada-4d62-8a0e-8a3120b277ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:43.720189 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279adf04-2ada-4d62-8a0e-8a3120b277ee service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:43.729441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1371/2717] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:44.000260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.001731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:44.013578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a90606-717e-4166-98c2-23c8fe63cea6 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.018866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.020164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.020664 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.020946 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] PATH_INFO: `/v3/projects/43c07fd26cd74cd892a7a331a995837f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.022114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c07fd26cd74cd892a7a331a995837f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.024036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.076287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c07fd26cd74cd892a7a331a995837f', 'request_id': 'req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:44.083690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c07fd26cd74cd892a7a331a995837f', 'request_id': 'req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:44.093196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c07fd26cd74cd892a7a331a995837f', 'request_id': 'req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:44.104881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] The token cache is being invalidate because project 43c07fd26cd74cd892a7a331a995837f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:44.105414 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:44.106144 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-35c70b13-09b9-4ab0-8d6b-78abd14e2b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:44.107800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1347/2718] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:43 2022] DELETE /identity/v3/projects/43c07fd26cd74cd892a7a331a995837f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:44.112932 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571bb84-e2de-4a12-aa5b-a162d7f005d3 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.113225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571bb84-e2de-4a12-aa5b-a162d7f005d3 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.113506 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571bb84-e2de-4a12-aa5b-a162d7f005d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.137674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c571bb84-e2de-4a12-aa5b-a162d7f005d3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:44.138901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c571bb84-e2de-4a12-aa5b-a162d7f005d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:44.186961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:44.205000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1372/2719] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:44.212808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968080-8bf3-42a1-b3f1-a27570c1130a None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.213103 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968080-8bf3-42a1-b3f1-a27570c1130a None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.213388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968080-8bf3-42a1-b3f1-a27570c1130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.233928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b7968080-8bf3-42a1-b3f1-a27570c1130a None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:44.235106 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b7968080-8bf3-42a1-b3f1-a27570c1130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:44.243117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1348/2720] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:44.247373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571bb84-e2de-4a12-aa5b-a162d7f005d3 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.257930 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571bb84-e2de-4a12-aa5b-a162d7f005d3 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.262456 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.263053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.263332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.263636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.264287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:44.264596 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.266850 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.278503 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1373/2721] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:44:44.282679 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968080-8bf3-42a1-b3f1-a27570c1130a None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.291876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968080-8bf3-42a1-b3f1-a27570c1130a None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.297212 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.297813 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.298093 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.298368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.299022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.300960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.305519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:44.330726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1349/2722] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:44 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:44.334806 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.345162 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece242-9663-40ac-91c8-9de288e06562 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.402815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.403441 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.403702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.403978 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.404605 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.407068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.428674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1374/2723] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:44 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:44.432800 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.444167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91981-f508-4c9b-a6ef-99e6bb357553 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.448820 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.449417 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.449701 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.450063 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.450715 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.452361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.462269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1350/2724] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:44.466072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.476216 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf292a-257b-46d9-85fc-1532759eb61d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.480736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db973d58-4241-4dc0-87e6-2308c24c3547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.481324 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db973d58-4241-4dc0-87e6-2308c24c3547 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.481601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db973d58-4241-4dc0-87e6-2308c24c3547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.481879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db973d58-4241-4dc0-87e6-2308c24c3547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.482540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db973d58-4241-4dc0-87e6-2308c24c3547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.484842 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db973d58-4241-4dc0-87e6-2308c24c3547 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.495291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1375/2725] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:44.501636 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.512078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf4ca-f6e9-4245-b507-538a22395b8c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.516934 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.517610 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.517839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.518116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] PATH_INFO: `/v3/projects/5b0e0260c9224d08b183c9b08813f121/users/7cf8105c479d4c449fa41a5760821427/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.534757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0e0260c9224d08b183c9b08813f121, user_id=7cf8105c479d4c449fa41a5760821427, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.537482 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.551870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1351/2726] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:44 2022] PUT /identity/v3/projects/5b0e0260c9224d08b183c9b08813f121/users/7cf8105c479d4c449fa41a5760821427/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:44.563113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23671ee3-cec0-46a6-b136-96e2659d7872 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.563661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23671ee3-cec0-46a6-b136-96e2659d7872 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.563945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23671ee3-cec0-46a6-b136-96e2659d7872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.592177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-23671ee3-cec0-46a6-b136-96e2659d7872 None None] MFA Rules not processed for user `7cf8105c479d4c449fa41a5760821427`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:44.593599 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-23671ee3-cec0-46a6-b136-96e2659d7872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:44.669931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1376/2727] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:44.678181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:44.680880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:44.745907 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527c51-1042-4fca-8cc2-563f25b99708 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:44.749560 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:44.750535 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:44.750823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:44.751097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:44.759448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:44.760895 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:44.769893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1352/2728] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:46.840326 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a9a7e-ca2b-47e5-8b86-5c7d44b6d501 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:46.840794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a9a7e-ca2b-47e5-8b86-5c7d44b6d501 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:46.840794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a9a7e-ca2b-47e5-8b86-5c7d44b6d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:46.860610 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f94a9a7e-ca2b-47e5-8b86-5c7d44b6d501 None None] MFA Rules not processed for user `bc308e1725504b9893aa9bdea4c59bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:46.861795 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f94a9a7e-ca2b-47e5-8b86-5c7d44b6d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:46.901391 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:46.918535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1377/2729] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:54.668956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:54.670338 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:54.726981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe71c1-240d-4f70-af47-b5b0fe479174 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:54.730531 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb842c1b-3d26-4935-b49c-8d4406feca2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:54.731123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842c1b-3d26-4935-b49c-8d4406feca2d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:54.731404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842c1b-3d26-4935-b49c-8d4406feca2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:54.731865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842c1b-3d26-4935-b49c-8d4406feca2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:54.734249 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fb842c1b-3d26-4935-b49c-8d4406feca2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:54.797245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb842c1b-3d26-4935-b49c-8d4406feca2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:54.798677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb842c1b-3d26-4935-b49c-8d4406feca2d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:54.808356 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1353/2730] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:55.114200 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a9a7e-ca2b-47e5-8b86-5c7d44b6d501 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:55.127639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a9a7e-ca2b-47e5-8b86-5c7d44b6d501 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:55.132580 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:55.133213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:55.133491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:55.133765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] PATH_INFO: `/v3/users/7cf8105c479d4c449fa41a5760821427` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:55.134887 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf8105c479d4c449fa41a5760821427)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:55.136854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:55.186031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf8105c479d4c449fa41a5760821427'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.187262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf8105c479d4c449fa41a5760821427'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.199779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf8105c479d4c449fa41a5760821427'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.207855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf8105c479d4c449fa41a5760821427'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.208625 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf8105c479d4c449fa41a5760821427'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.224659 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1378/2731] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:55 2022] DELETE /identity/v3/users/7cf8105c479d4c449fa41a5760821427 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:55.226368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:55.226726 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:55.227127 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:55.235038 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:55.248943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:55.250277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:55.313434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1354/2732] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:55.323089 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:55.324582 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:55.383736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33289b4-f7f6-4ea7-948e-005732da0735 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:55.387350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:55.387996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:55.388281 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:55.388560 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:55.397893 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:55.399353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:55.409710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1379/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:44:55.682271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:55.684643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:55.706459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb07625-f856-4481-9ec2-e665ecfef225 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:55.712493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:55.713183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:55.713496 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:55.713771 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] PATH_INFO: `/v3/projects/5b0e0260c9224d08b183c9b08813f121` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:55.714848 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0e0260c9224d08b183c9b08813f121)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:55.716807 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:55.772266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0e0260c9224d08b183c9b08813f121', 'request_id': 'req-ef193b5a-46a5-497f-8fcc-44abd14f5c79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.780059 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0e0260c9224d08b183c9b08813f121', 'request_id': 'req-ef193b5a-46a5-497f-8fcc-44abd14f5c79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.791337 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0e0260c9224d08b183c9b08813f121', 'request_id': 'req-ef193b5a-46a5-497f-8fcc-44abd14f5c79'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.809407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] The token cache is being invalidate because project 5b0e0260c9224d08b183c9b08813f121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:55.809656 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.814600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:55.816354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1355/2734] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:55 2022] DELETE /identity/v3/projects/5b0e0260c9224d08b183c9b08813f121 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:58.358936 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:58.360561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:58.373717 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6674-8195-4232-928e-b2d070f030be service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:58.437481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:58.438125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:58.438407 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:58.438687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] PATH_INFO: `/v3/users/c2632b005b784efc8fcbe90cb7376529` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:58.439863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2632b005b784efc8fcbe90cb7376529)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:58.441851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:58.446723 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:58.492061 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2632b005b784efc8fcbe90cb7376529'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.492718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2632b005b784efc8fcbe90cb7376529'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.505635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2632b005b784efc8fcbe90cb7376529'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.513502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2632b005b784efc8fcbe90cb7376529'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.514205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-dc934bfe-dd9c-4ebe-a7d7-e1bb731fcf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2632b005b784efc8fcbe90cb7376529'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.526965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1380/2735] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:44:58 2022] DELETE /identity/v3/users/c2632b005b784efc8fcbe90cb7376529 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:58.709812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:58.711315 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:58.725852 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef193b5a-46a5-497f-8fcc-44abd14f5c79 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:58.791392 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:58.792075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:58.792355 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:58.792624 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] PATH_INFO: `/v3/projects/18abe1faae844933855e27f18d0e2cee` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:58.793736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18abe1faae844933855e27f18d0e2cee)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:58.795897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:58.829197 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:58.846395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18abe1faae844933855e27f18d0e2cee', 'request_id': 'req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.853048 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18abe1faae844933855e27f18d0e2cee', 'request_id': 'req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.860958 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18abe1faae844933855e27f18d0e2cee', 'request_id': 'req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.871856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] The token cache is being invalidate because project 18abe1faae844933855e27f18d0e2cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:44:58.872147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.872879 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-22e2f1c0-dc8b-47c8-aac3-8e9055a3f2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:44:58.874480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1356/2736] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:44:58 2022] DELETE /identity/v3/projects/18abe1faae844933855e27f18d0e2cee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:58.879819 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e17ea6-9963-42ea-ad5b-a1efc2ce83b1 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:58.880210 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e17ea6-9963-42ea-ad5b-a1efc2ce83b1 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:58.880449 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e17ea6-9963-42ea-ad5b-a1efc2ce83b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:58.904047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-12e17ea6-9963-42ea-ad5b-a1efc2ce83b1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:58.906080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-12e17ea6-9963-42ea-ad5b-a1efc2ce83b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:58.980116 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1381/2737] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:58.989191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85164738-f6ce-4d3c-9598-7bfd7af2388f None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:58.989476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85164738-f6ce-4d3c-9598-7bfd7af2388f None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:58.989750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85164738-f6ce-4d3c-9598-7bfd7af2388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.011046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-85164738-f6ce-4d3c-9598-7bfd7af2388f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:59.012285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-85164738-f6ce-4d3c-9598-7bfd7af2388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:59.020877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1357/2738] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:59.025067 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e17ea6-9963-42ea-ad5b-a1efc2ce83b1 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:59.035190 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e17ea6-9963-42ea-ad5b-a1efc2ce83b1 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:59.040017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:59.040621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.040901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.041175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.041825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:44:59.042128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:59.043808 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:59.060223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1382/2739] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:44:59.061966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85164738-f6ce-4d3c-9598-7bfd7af2388f None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:59.071251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85164738-f6ce-4d3c-9598-7bfd7af2388f None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:59.076152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:59.076790 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.077080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.077975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.078703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:59.080718 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:59.116360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1358/2740] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:44:59 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:59.120494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:59.131344 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f007b-a360-4609-addc-48e768443130 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:59.320502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:59.321141 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.321422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.321699 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.322329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:59.324380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:59.341088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:44:59.351381 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1383/2741] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:44:59 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:44:59.352321 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:59.363427 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceb523-18c7-4d26-93d2-c56dcfff6a27 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:59.367982 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:59.368584 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.368867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.369142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.369784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:59.371389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:59.382623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1359/2742] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:59.386577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:59.397527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f7897-baab-4251-bdd4-310aaeda98d6 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:59.403337 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027eb63-dee9-4220-ba10-9bc159f9fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:59.404121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027eb63-dee9-4220-ba10-9bc159f9fc3a admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.404401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027eb63-dee9-4220-ba10-9bc159f9fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.404675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027eb63-dee9-4220-ba10-9bc159f9fc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.405530 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027eb63-dee9-4220-ba10-9bc159f9fc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:59.407277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027eb63-dee9-4220-ba10-9bc159f9fc3a admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:59.417414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1384/2743] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:44:59.422145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:59.432258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d551-9500-4897-8ca4-63ee6ec94c1c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:59.437539 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:59.438242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.438527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.438805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] PATH_INFO: `/v3/projects/69bf51b15a434588a21b775161bebd20/users/78abd968c9634dcdb94a69a7c80a6696/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.453236 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bf51b15a434588a21b775161bebd20, user_id=78abd968c9634dcdb94a69a7c80a6696, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:59.455923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:59.468572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1360/2744] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:44:59 2022] PUT /identity/v3/projects/69bf51b15a434588a21b775161bebd20/users/78abd968c9634dcdb94a69a7c80a6696/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:44:59.473528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1f71-1763-4d4b-a34f-7ccfbc7a57b6 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.473815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1f71-1763-4d4b-a34f-7ccfbc7a57b6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.474090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc1f71-1763-4d4b-a34f-7ccfbc7a57b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.493796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7abc1f71-1763-4d4b-a34f-7ccfbc7a57b6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:44:59.494980 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7abc1f71-1763-4d4b-a34f-7ccfbc7a57b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:59.553687 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1385/2745] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:44:59.563933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:44:59.565606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:44:59.620532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce59350-c02d-4480-9508-8d479d9fa7ae admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:44:59.624877 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b6d7f-364f-4ad6-80bf-99a80171d2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:44:59.625558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b6d7f-364f-4ad6-80bf-99a80171d2de service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:44:59.625846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b6d7f-364f-4ad6-80bf-99a80171d2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:44:59.626128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b6d7f-364f-4ad6-80bf-99a80171d2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:44:59.635094 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b6d7f-364f-4ad6-80bf-99a80171d2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:44:59.636542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b6d7f-364f-4ad6-80bf-99a80171d2de service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:44:59.646069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1361/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:04.229790 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:04.230235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:04.230235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:04.264443 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] MFA Rules not processed for user `78abd968c9634dcdb94a69a7c80a6696`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:04.267148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:04.323519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:04.324026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:04.324142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:04.350555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:04.352215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:04.381153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1386/2747] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:04.389062 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:04.392914 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:04.412589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:04.429306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1362/2748] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:45:04.451717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:04.453386 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:04.491562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e1a2d-0ea1-4a6e-af34-13eb47073644 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:04.499121 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a12acf-0dd1-4591-a72d-de41d0186181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:04.500235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a12acf-0dd1-4591-a72d-de41d0186181 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:04.500523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a12acf-0dd1-4591-a72d-de41d0186181 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:04.500802 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a12acf-0dd1-4591-a72d-de41d0186181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:04.510125 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a12acf-0dd1-4591-a72d-de41d0186181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:04.512090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a12acf-0dd1-4591-a72d-de41d0186181 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:04.522235 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1387/2749] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:45:04.532962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8666d0-4257-4e33-b7fb-ac7d20cfab60 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:04.538999 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e748c86-dea7-452b-8236-796c49082ce4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:04.539904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748c86-dea7-452b-8236-796c49082ce4 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:04.540469 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748c86-dea7-452b-8236-796c49082ce4 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:04.540607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748c86-dea7-452b-8236-796c49082ce4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:04.550723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e748c86-dea7-452b-8236-796c49082ce4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:04.552543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e748c86-dea7-452b-8236-796c49082ce4 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:04.562583 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1363/2750] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:45:06.285298 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca973-4f9c-4c75-85d0-47532170f1c5 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:06.285870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca973-4f9c-4c75-85d0-47532170f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:06.285963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca973-4f9c-4c75-85d0-47532170f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:06.296445 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:06.308971 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-6dcca973-4f9c-4c75-85d0-47532170f1c5 None None] MFA Rules not processed for user `78abd968c9634dcdb94a69a7c80a6696`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:06.310202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6dcca973-4f9c-4c75-85d0-47532170f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:06.318720 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1388/2751] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:14.558563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=32 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:16.305007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:21.124506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:21.124996 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:21.125097 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:21.144743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:21.145956 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:21.153120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1364/2752] 10.222.0.16 () {58 vars in 967 bytes} [Mon Sep 5 10:45:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:21.166380 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca973-4f9c-4c75-85d0-47532170f1c5 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:21.178938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca973-4f9c-4c75-85d0-47532170f1c5 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:21.184026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:21.184621 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:21.184959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:21.185234 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:21.193818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:21.195408 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:21.204478 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1389/2753] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:45:23.049854 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.051342 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:23.109392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.110911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:23.133465 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c14a7-c891-46cb-ba51-5dbb227a911c service swift] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.138357 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.140113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.140402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.140705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] PATH_INFO: `/v3/users/bc308e1725504b9893aa9bdea4c59bbf` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.141119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a191c-9651-402a-b4c7-50c2df3df965 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.141830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc308e1725504b9893aa9bdea4c59bbf)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.143838 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.146108 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.146741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.147023 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.147294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.149187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:23.161350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.163034 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.173661 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1365/2754] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:23.194511 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc308e1725504b9893aa9bdea4c59bbf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.195168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc308e1725504b9893aa9bdea4c59bbf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.210238 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc308e1725504b9893aa9bdea4c59bbf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.217688 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc308e1725504b9893aa9bdea4c59bbf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.218343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-54337f1f-dd0d-45c8-88f6-4d5aabf15fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc308e1725504b9893aa9bdea4c59bbf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.230883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1390/2755] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:45:23 2022] DELETE /identity/v3/users/bc308e1725504b9893aa9bdea4c59bbf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:23.407296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.418832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2816d4-b575-4c26-bc6b-2dd53091114b service placement] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.479258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.479948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.480293 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.480573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] PATH_INFO: `/v3/projects/41ac4607c48d40fd84baf2d53a0b1f46` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.481805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ac4607c48d40fd84baf2d53a0b1f46)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.484431 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.537975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ac4607c48d40fd84baf2d53a0b1f46', 'request_id': 'req-4d51068b-d4bc-4be9-b012-0ad40c69898a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.545897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ac4607c48d40fd84baf2d53a0b1f46', 'request_id': 'req-4d51068b-d4bc-4be9-b012-0ad40c69898a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.554311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ac4607c48d40fd84baf2d53a0b1f46', 'request_id': 'req-4d51068b-d4bc-4be9-b012-0ad40c69898a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.566247 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] The token cache is being invalidate because project 41ac4607c48d40fd84baf2d53a0b1f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:45:23.566541 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.567209 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-4d51068b-d4bc-4be9-b012-0ad40c69898a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:23.568965 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1366/2756] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:45:23 2022] DELETE /identity/v3/projects/41ac4607c48d40fd84baf2d53a0b1f46 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:23.573797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6d5f-e5d6-42ac-9804-304d9bde8a3e None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.574084 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6d5f-e5d6-42ac-9804-304d9bde8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.574363 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af6d5f-e5d6-42ac-9804-304d9bde8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.595270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-68af6d5f-e5d6-42ac-9804-304d9bde8a3e None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:23.596541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-68af6d5f-e5d6-42ac-9804-304d9bde8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:23.656583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1391/2757] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:23.664200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d7d4a-4a95-4946-88ee-01ea3ca60ca1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.664488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d7d4a-4a95-4946-88ee-01ea3ca60ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.664759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d7d4a-4a95-4946-88ee-01ea3ca60ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.684142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-650d7d4a-4a95-4946-88ee-01ea3ca60ca1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:23.685891 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-650d7d4a-4a95-4946-88ee-01ea3ca60ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:23.694002 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1367/2758] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:23.698152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6d5f-e5d6-42ac-9804-304d9bde8a3e None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.708554 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af6d5f-e5d6-42ac-9804-304d9bde8a3e None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.713070 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.713666 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.713945 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.714218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.714863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:45:23.715166 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.716831 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.728051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1392/2759] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:45:23.732521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d7d4a-4a95-4946-88ee-01ea3ca60ca1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.741632 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d7d4a-4a95-4946-88ee-01ea3ca60ca1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.746214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.746835 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.747118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.747393 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.748580 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.750499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.755190 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:23.781246 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1368/2760] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:45:23 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:45:23.785081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.794947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb82bb-67b3-4dcc-8e12-318e8b01fdd8 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.839334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:23.853752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.854353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.854627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.854905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.855557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.857815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.877903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1393/2761] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:45:23 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:45:23.882380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.892716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792942-ca6e-4bb0-88bf-677257f38358 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.897215 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.897799 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.898078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.898346 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.898975 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.900587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.911115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1369/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:45:23.914927 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.925320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa4fa3-4f6c-47f9-9afa-4f846813e593 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.929874 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82219fea-bcdc-4bfe-8556-787744bc8d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.930453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219fea-bcdc-4bfe-8556-787744bc8d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.930728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219fea-bcdc-4bfe-8556-787744bc8d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.930997 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219fea-bcdc-4bfe-8556-787744bc8d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.931648 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82219fea-bcdc-4bfe-8556-787744bc8d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.933236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82219fea-bcdc-4bfe-8556-787744bc8d61 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.942879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1394/2763] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:45:23.946937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:23.957229 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57873e16-2279-447c-9307-0379b8be8013 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:23.961818 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:23.962457 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:23.962736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:23.963007 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] PATH_INFO: `/v3/projects/efc3cbcae6ba4cd2a6e1792e572350bc/users/7fd8894f1656414dbbfb28895a3f81d7/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:23.977890 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc3cbcae6ba4cd2a6e1792e572350bc, user_id=7fd8894f1656414dbbfb28895a3f81d7, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:23.980549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:23.994834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1370/2764] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:45:23 2022] PUT /identity/v3/projects/efc3cbcae6ba4cd2a6e1792e572350bc/users/7fd8894f1656414dbbfb28895a3f81d7/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:24.005299 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:24.005585 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:24.005859 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:24.033977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] MFA Rules not processed for user `7fd8894f1656414dbbfb28895a3f81d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:24.035203 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:24.098903 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1395/2765] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:24.110277 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:24.111971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:24.170306 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e06049-f5c4-4ecc-ad64-0820f2b59513 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:24.174026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:24.174630 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:24.174911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:24.175187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:24.183502 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:24.184949 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:24.193682 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1371/2766] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:28.531655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:28.533080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:28.593770 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfbab8-0903-41bc-8f70-dd21680902b8 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:28.597385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:28.597991 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:28.598273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:28.598548 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:28.600270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:28.658198 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:28.659673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:28.668495 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1396/2767] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:45:33.497805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:33.507843 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa6a8-61b1-4f81-bbf0-f4be6c1398d3 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:33.511429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:33.512075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:33.512344 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:33.512620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:33.514301 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:33.577861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:33.579508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:33.589121 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1372/2768] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:38.664437 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:40.347224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:40.348714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:40.366979 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76901c99-d9b0-4c72-ad26-459c8718a42c service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:40.371827 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:40.372514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:40.372794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:40.373065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] PATH_INFO: `/v3/users/c79b2adcfb2742368169681653cdc7f9` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:40.374193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79b2adcfb2742368169681653cdc7f9)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:40.377177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:40.426383 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79b2adcfb2742368169681653cdc7f9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.427063 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79b2adcfb2742368169681653cdc7f9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.439336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79b2adcfb2742368169681653cdc7f9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.447476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79b2adcfb2742368169681653cdc7f9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.448403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79b2adcfb2742368169681653cdc7f9'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.461826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1397/2769] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:45:40 2022] DELETE /identity/v3/users/c79b2adcfb2742368169681653cdc7f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:40.644187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:40.655146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4e939-30a4-40e3-af79-17ce9d989821 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:40.701388 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:40.714600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:40.715234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:40.715516 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:40.715822 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] PATH_INFO: `/v3/projects/7c2c32d8b6ef48359f588ef485949bf1` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:40.716943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2c32d8b6ef48359f588ef485949bf1)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:40.719485 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:40.766072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2c32d8b6ef48359f588ef485949bf1', 'request_id': 'req-3f71c8b5-49c9-416e-8300-51753f6ed8ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.772201 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2c32d8b6ef48359f588ef485949bf1', 'request_id': 'req-3f71c8b5-49c9-416e-8300-51753f6ed8ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.779449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2c32d8b6ef48359f588ef485949bf1', 'request_id': 'req-3f71c8b5-49c9-416e-8300-51753f6ed8ff'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.790425 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] The token cache is being invalidate because project 7c2c32d8b6ef48359f588ef485949bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:45:40.790740 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.791395 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.794151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1373/2770] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:45:40 2022] DELETE /identity/v3/projects/7c2c32d8b6ef48359f588ef485949bf1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:40.797992 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:40.799439 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:40.812521 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460a73a-d2bd-4276-a6e0-32315c719164 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:40.869278 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:40.869820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:40.870101 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:40.870377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] PATH_INFO: `/v3/users/cc2489808b4a4a3993c1191117700c75` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:40.871721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2489808b4a4a3993c1191117700c75)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:40.873749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:40.925764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2489808b4a4a3993c1191117700c75'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.926413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2489808b4a4a3993c1191117700c75'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.938338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2489808b4a4a3993c1191117700c75'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.945926 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2489808b4a4a3993c1191117700c75'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.946581 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2489808b4a4a3993c1191117700c75'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:40.949068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:40.962749 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1398/2771] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:45:40 2022] DELETE /identity/v3/users/cc2489808b4a4a3993c1191117700c75 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:41.144303 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:41.145871 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:41.159631 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71c8b5-49c9-416e-8300-51753f6ed8ff admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:41.217893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:41.219787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:41.220078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:41.220354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] PATH_INFO: `/v3/projects/eadb590f51d74b52aee3019ab44e058f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:41.221667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadb590f51d74b52aee3019ab44e058f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:41.224376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:41.273253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadb590f51d74b52aee3019ab44e058f', 'request_id': 'req-834fd1d8-8af1-488a-bd1e-c68491aac4bb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:41.279747 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadb590f51d74b52aee3019ab44e058f', 'request_id': 'req-834fd1d8-8af1-488a-bd1e-c68491aac4bb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:41.287689 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadb590f51d74b52aee3019ab44e058f', 'request_id': 'req-834fd1d8-8af1-488a-bd1e-c68491aac4bb'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:41.298227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] The token cache is being invalidate because project eadb590f51d74b52aee3019ab44e058f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:45:41.298522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:41.299155 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-834fd1d8-8af1-488a-bd1e-c68491aac4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:41.300680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1374/2772] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:45:41 2022] DELETE /identity/v3/projects/eadb590f51d74b52aee3019ab44e058f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:45:50.961935 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:51.295031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:54.348879 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:54.350301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:54.362951 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad9507-6466-4501-a91b-92a3314075e1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:54.419754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:54.420309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:54.420592 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:54.420869 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] PATH_INFO: `/v3/users/7fd8894f1656414dbbfb28895a3f81d7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:54.421983 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd8894f1656414dbbfb28895a3f81d7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:54.423940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:54.469053 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd8894f1656414dbbfb28895a3f81d7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:54.469708 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd8894f1656414dbbfb28895a3f81d7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:54.482018 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd8894f1656414dbbfb28895a3f81d7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:54.489482 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd8894f1656414dbbfb28895a3f81d7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:54.490097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd8894f1656414dbbfb28895a3f81d7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:54.501994 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1399/2773] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:45:54 2022] DELETE /identity/v3/users/7fd8894f1656414dbbfb28895a3f81d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:54.507366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:54.507869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:54.507969 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:54.527283 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:54.528534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:54.587171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1375/2774] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:54.596947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:54.598576 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:54.656060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd9bdb-d6b4-4a7d-af4d-f07e41915bf4 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:54.660701 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33903ac4-62ba-46b7-96e9-34ab741c9f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:54.661305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903ac4-62ba-46b7-96e9-34ab741c9f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:54.661587 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903ac4-62ba-46b7-96e9-34ab741c9f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:54.661960 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903ac4-62ba-46b7-96e9-34ab741c9f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:54.671385 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33903ac4-62ba-46b7-96e9-34ab741c9f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:54.672798 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33903ac4-62ba-46b7-96e9-34ab741c9f8f service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:54.683253 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1400/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:45:54.973570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:54.974928 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:54.991238 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af1e12-53ca-4295-86d5-ce9e80b659d4 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:54.999504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.000423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.001169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.001906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] PATH_INFO: `/v3/projects/efc3cbcae6ba4cd2a6e1792e572350bc` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.005257 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc3cbcae6ba4cd2a6e1792e572350bc)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.007563 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.067404 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc3cbcae6ba4cd2a6e1792e572350bc', 'request_id': 'req-5579d431-719a-486f-8cf2-0c0c25f9f16a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:55.073600 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc3cbcae6ba4cd2a6e1792e572350bc', 'request_id': 'req-5579d431-719a-486f-8cf2-0c0c25f9f16a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:55.081178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc3cbcae6ba4cd2a6e1792e572350bc', 'request_id': 'req-5579d431-719a-486f-8cf2-0c0c25f9f16a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:55.092590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] The token cache is being invalidate because project efc3cbcae6ba4cd2a6e1792e572350bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:45:55.092900 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:55.093536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-5579d431-719a-486f-8cf2-0c0c25f9f16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:45:55.095009 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1376/2776] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:45:54 2022] DELETE /identity/v3/projects/efc3cbcae6ba4cd2a6e1792e572350bc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:55.100811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00cf69-02a7-4727-8814-780202f01133 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.101114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00cf69-02a7-4727-8814-780202f01133 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.101397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00cf69-02a7-4727-8814-780202f01133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.120889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-7a00cf69-02a7-4727-8814-780202f01133 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:55.122090 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7a00cf69-02a7-4727-8814-780202f01133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:55.139464 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:55.184401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1401/2777] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:55.192440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83bd91-31e1-44af-834f-0c4de9088643 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.192665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83bd91-31e1-44af-834f-0c4de9088643 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.192943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83bd91-31e1-44af-834f-0c4de9088643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.213451 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6e83bd91-31e1-44af-834f-0c4de9088643 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:55.214660 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6e83bd91-31e1-44af-834f-0c4de9088643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:55.223318 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1377/2778] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:55.227518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00cf69-02a7-4727-8814-780202f01133 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:55.237163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00cf69-02a7-4727-8814-780202f01133 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:55.242486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.243079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.243358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.243661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.244309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:45:55.244611 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.246199 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.258907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1402/2779] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:45:55.262916 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83bd91-31e1-44af-834f-0c4de9088643 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:55.272262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83bd91-31e1-44af-834f-0c4de9088643 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:55.276810 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.277428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.277711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.277990 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.278628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.280570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.307492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1378/2780] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:45:55 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:45:55.311608 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:55.321944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c34643-1e90-4d6f-80d8-83b4bcef7e14 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:55.377728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.378665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.379405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.379719 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.380353 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.382275 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.402622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1403/2781] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:45:55 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:45:55.406764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:55.417789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc2b53-01ec-430b-afc8-ef599d1477de admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:55.422474 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.423064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.423361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.423651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.424299 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.426503 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.436363 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1379/2782] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:45:55.440308 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:55.450442 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381333ec-8e46-4f6f-ae8b-aaa6294c6837 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:55.455111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04388f5-50d7-4336-87cb-a79177110f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.455854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04388f5-50d7-4336-87cb-a79177110f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.456142 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04388f5-50d7-4336-87cb-a79177110f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.456416 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04388f5-50d7-4336-87cb-a79177110f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.457188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04388f5-50d7-4336-87cb-a79177110f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.458781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04388f5-50d7-4336-87cb-a79177110f3b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.469093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1404/2783] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:45:55.473675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:55.483499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aaa59-2c34-458f-b554-638c81032e51 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:55.488729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.489434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.489712 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.489988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] PATH_INFO: `/v3/projects/d9731c0cd36d49959eab6e9fdb0676ce/users/180e1b820e5d42348b5c92328858d57b/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.504904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9731c0cd36d49959eab6e9fdb0676ce, user_id=180e1b820e5d42348b5c92328858d57b, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.507607 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.520549 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1380/2784] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:45:55 2022] PUT /identity/v3/projects/d9731c0cd36d49959eab6e9fdb0676ce/users/180e1b820e5d42348b5c92328858d57b/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:45:55.525461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2764a-a225-416b-b45a-13ee53d5b2d6 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.525752 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2764a-a225-416b-b45a-13ee53d5b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.526057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2764a-a225-416b-b45a-13ee53d5b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.545071 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c4f2764a-a225-416b-b45a-13ee53d5b2d6 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:55.546262 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c4f2764a-a225-416b-b45a-13ee53d5b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:55.606847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1405/2785] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:55.616899 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:55.618625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:55.640905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:55.678787 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d61438-69a3-4314-8f7a-a9214608aa49 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:55.682477 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:55.683079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:55.683368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:55.683676 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:55.692518 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:55.693950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:45:55.703435 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1381/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 10:45:59.808562 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba228f-be46-4288-8009-154ce5383023 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:59.809065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba228f-be46-4288-8009-154ce5383023 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:59.809195 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba228f-be46-4288-8009-154ce5383023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:59.843527 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2fba228f-be46-4288-8009-154ce5383023 None None] MFA Rules not processed for user `180e1b820e5d42348b5c92328858d57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:45:59.844961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2fba228f-be46-4288-8009-154ce5383023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:45:59.891959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:45:59.971636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1406/2787] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:45:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:45:59.975307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:45:59.985763 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84c3f-a781-45a9-88aa-4f5f29e6c03d service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:45:59.990643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:45:59.991259 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:45:59.991543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:45:59.991856 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:45:59.992499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:45:59.994411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:00.038159 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1382/2788] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:45:59 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:46:00.039676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba228f-be46-4288-8009-154ce5383023 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:00.050998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba228f-be46-4288-8009-154ce5383023 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:00.126098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:00.126664 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:00.126953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:00.127233 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:00.128822 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:00.132016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:00.158491 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1407/2789] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:46:00 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:46:00.164176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:00.179845 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286f8e-c04b-4c29-978f-dbacf5429fd9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:00.185280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:00.185903 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:00.186191 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:00.186468 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:00.187176 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:00.188948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:00.202167 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1383/2790] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:46:00.206219 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:00.216933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c3b5e-3991-4861-991c-6a4c6a417791 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:00.221789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:00.223075 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:00.223365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:00.223825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] PATH_INFO: `/v3/projects/c3bcec660e644d51969308598a82ef4f/users/5d7ee4f8438b447bb3efbb0fb18f4d2b/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:00.242690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bcec660e644d51969308598a82ef4f, user_id=5d7ee4f8438b447bb3efbb0fb18f4d2b, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:00.245602 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:00.261861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1408/2791] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:46:00 2022] PUT /identity/v3/projects/c3bcec660e644d51969308598a82ef4f/users/5d7ee4f8438b447bb3efbb0fb18f4d2b/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:46:00.265888 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:00.278062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ca108-6317-452f-b24e-ff4ae17f0d91 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:00.347003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8abf-7182-4632-9b50-e63bd72f437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:00.352589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8abf-7182-4632-9b50-e63bd72f437a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:00.352886 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8abf-7182-4632-9b50-e63bd72f437a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:00.353166 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8abf-7182-4632-9b50-e63bd72f437a admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:00.353844 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8abf-7182-4632-9b50-e63bd72f437a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:00.356311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8abf-7182-4632-9b50-e63bd72f437a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:00.381992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1384/2792] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:46:00.386685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:00.399228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e82b-d020-4897-b6f8-778122c7c156 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:00.404012 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a53f9-d6a7-4d45-a104-6a50dcc6e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:00.404675 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a53f9-d6a7-4d45-a104-6a50dcc6e89f admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:00.404953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a53f9-d6a7-4d45-a104-6a50dcc6e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:00.405224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a53f9-d6a7-4d45-a104-6a50dcc6e89f admin admin] PATH_INFO: `/v3/projects/c3bcec660e644d51969308598a82ef4f/users/5d7ee4f8438b447bb3efbb0fb18f4d2b/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:00.407136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a53f9-d6a7-4d45-a104-6a50dcc6e89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bcec660e644d51969308598a82ef4f, user_id=5d7ee4f8438b447bb3efbb0fb18f4d2b, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:00.410533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a53f9-d6a7-4d45-a104-6a50dcc6e89f admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:00.432034 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1409/2793] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:46:00 2022] PUT /identity/v3/projects/c3bcec660e644d51969308598a82ef4f/users/5d7ee4f8438b447bb3efbb0fb18f4d2b/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:46:00.458181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:00.458475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:00.459022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:00.481729 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] MFA Rules not processed for user `78abd968c9634dcdb94a69a7c80a6696`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:00.483096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:00.563833 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1385/2794] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:46:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:05.627045 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cd9eb-36b6-4e75-bf98-4c4ee75a1375 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:05.627512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cd9eb-36b6-4e75-bf98-4c4ee75a1375 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:05.627512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cd9eb-36b6-4e75-bf98-4c4ee75a1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:05.661890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a25cd9eb-36b6-4e75-bf98-4c4ee75a1375 None None] MFA Rules not processed for user `5d7ee4f8438b447bb3efbb0fb18f4d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:05.663257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a25cd9eb-36b6-4e75-bf98-4c4ee75a1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:05.729765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:05.744762 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1410/2795] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:46:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:05.758598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:05.760150 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:05.795237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:05.820604 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d277edb-ee2a-4dff-89b2-9115b729155d None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:05.824232 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717ade6a084349a8864cf15ce0d827fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:05.824842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:05.825123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:05.825397 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:05.884857 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:05.886226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:05.896324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1386/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:06.043048 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:06.043339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:06.043742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:06.064669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:06.066486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:06.158493 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1411/2797] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:06.188653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:06.190082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:06.286125 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d815d-29d9-42c3-b627-aadb38b845e2 service glance] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:06.291234 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8fda1-6f17-4f4c-b0b6-4de27ac62368 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:06.291893 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8fda1-6f17-4f4c-b0b6-4de27ac62368 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:06.292179 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8fda1-6f17-4f4c-b0b6-4de27ac62368 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:06.292456 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8fda1-6f17-4f4c-b0b6-4de27ac62368 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:06.311938 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8fda1-6f17-4f4c-b0b6-4de27ac62368 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:06.314285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8fda1-6f17-4f4c-b0b6-4de27ac62368 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:06.330526 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1387/2798] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:46:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:46:14.042612 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:14.044212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:14.178622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03893a4-b57f-478a-8bd2-1b0eeec94f9c None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:14.185426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bced4-1fc1-4b61-8e0f-10809d4b0e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:14.186767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bced4-1fc1-4b61-8e0f-10809d4b0e46 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:14.187257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bced4-1fc1-4b61-8e0f-10809d4b0e46 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:14.187771 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bced4-1fc1-4b61-8e0f-10809d4b0e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:14.189742 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6c4bced4-1fc1-4b61-8e0f-10809d4b0e46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:14.213339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bced4-1fc1-4b61-8e0f-10809d4b0e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:14.215173 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bced4-1fc1-4b61-8e0f-10809d4b0e46 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:14.250555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1412/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:15.559083 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f1bf-8e7e-4eec-acd6-102d9567e5ce None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:15.559653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f1bf-8e7e-4eec-acd6-102d9567e5ce None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:15.559653 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f1bf-8e7e-4eec-acd6-102d9567e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:15.581360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6515f1bf-8e7e-4eec-acd6-102d9567e5ce None None] MFA Rules not processed for user `180e1b820e5d42348b5c92328858d57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:15.582692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6515f1bf-8e7e-4eec-acd6-102d9567e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:15.589562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1388/2800] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:46:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:17.577494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772146-8460-4718-a769-a50f49db936f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:17.577961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772146-8460-4718-a769-a50f49db936f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:17.578081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772146-8460-4718-a769-a50f49db936f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:17.599263 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c1772146-8460-4718-a769-a50f49db936f None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:46:17.600654 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c1772146-8460-4718-a769-a50f49db936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:17.612846 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1413/2801] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Sep 5 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:46:17.629590 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515f1bf-8e7e-4eec-acd6-102d9567e5ce None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:17.641572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515f1bf-8e7e-4eec-acd6-102d9567e5ce None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:17.647658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7bd0-2d7a-44ee-90c4-988d64c45251 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:17.648378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7bd0-2d7a-44ee-90c4-988d64c45251 service swift] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:17.648780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7bd0-2d7a-44ee-90c4-988d64c45251 service swift] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:17.649062 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7bd0-2d7a-44ee-90c4-988d64c45251 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:17.657966 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7bd0-2d7a-44ee-90c4-988d64c45251 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:17.660764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7bd0-2d7a-44ee-90c4-988d64c45251 service swift] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:17.669271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1389/2802] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:46:27.593057 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=64 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:27.665724 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=75 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:46:37.863793 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1772146-8460-4718-a769-a50f49db936f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:46:37.865211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c1772146-8460-4718-a769-a50f49db936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:46:37.949342 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1772146-8460-4718-a769-a50f49db936f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:46:37.952947 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:46:37.953557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:46:37.953834 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:46:37.954111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:46:37.982672 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:46:37.984147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:46:37.994000 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1414/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:46:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:46:47.989929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=48 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:01.585368 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69cd2-4d15-463c-8c3b-ff6d92668bbd None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:01.585902 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69cd2-4d15-463c-8c3b-ff6d92668bbd None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:01.586027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69cd2-4d15-463c-8c3b-ff6d92668bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:01.604532 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-74e69cd2-4d15-463c-8c3b-ff6d92668bbd None None] MFA Rules not processed for user `78abd968c9634dcdb94a69a7c80a6696`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:47:01.605728 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-74e69cd2-4d15-463c-8c3b-ff6d92668bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:01.612480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1390/2804] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:47:03.716963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:47:03.718347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:03.807694 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916203-2db2-491d-997d-5157cdf18c76 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:47:03.812785 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:47:03.813389 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:47:03.813673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:47:03.813948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:47:03.815783 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:47:03.826919 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:47:03.828533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:47:03.838257 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1415/2805] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:47:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:47:11.599789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:47:13.834087 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=41 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:01.071420 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540e8-8272-4f92-b388-a89fc6cd9f43 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:01.071947 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540e8-8272-4f92-b388-a89fc6cd9f43 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:01.072052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540e8-8272-4f92-b388-a89fc6cd9f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:01.104216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-a1c540e8-8272-4f92-b388-a89fc6cd9f43 None None] MFA Rules not processed for user `5a06e8f4c38d42fe8e56c86a3834ec11`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:01.105426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-a1c540e8-8272-4f92-b388-a89fc6cd9f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:01.119826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1391/2806] 10.222.0.16 () {58 vars in 967 bytes} [Mon Sep 5 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:01.161120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:01.172681 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe328-2e05-4f6e-ba57-166bc1ee9c1d service placement] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:01.177684 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e810111bda874bf2aa808991089c2197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:01.178279 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:01.178561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:01.178940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:01.186820 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:01.188446 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:01.196737 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1416/2807] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Sep 5 10:48:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 10:48:03.223426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726b9b1-ab20-4c61-a111-3168fe97678c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:03.223919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726b9b1-ab20-4c61-a111-3168fe97678c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:03.224117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726b9b1-ab20-4c61-a111-3168fe97678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:03.244449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-3726b9b1-ab20-4c61-a111-3168fe97678c None None] MFA Rules not processed for user `78abd968c9634dcdb94a69a7c80a6696`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:48:03.245711 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-3726b9b1-ab20-4c61-a111-3168fe97678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:03.253558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1392/2808] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:48:09.111370 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:09.198958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1339b-ca78-4f78-951c-18b9223eadec service swift] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:09.203519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:09.204201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:09.204484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:09.204755 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] PATH_INFO: `/v3/users/180e1b820e5d42348b5c92328858d57b` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:09.205863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=180e1b820e5d42348b5c92328858d57b)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:09.207816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:09.254330 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180e1b820e5d42348b5c92328858d57b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.254996 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180e1b820e5d42348b5c92328858d57b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.266966 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180e1b820e5d42348b5c92328858d57b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.274134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180e1b820e5d42348b5c92328858d57b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.274750 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180e1b820e5d42348b5c92328858d57b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.286939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1417/2809] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:48:09 2022] DELETE /identity/v3/users/180e1b820e5d42348b5c92328858d57b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:48:09.464544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726b9b1-ab20-4c61-a111-3168fe97678c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:09.482906 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726b9b1-ab20-4c61-a111-3168fe97678c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:09.544360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:09.545046 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:09.545329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:09.545606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] PATH_INFO: `/v3/projects/d9731c0cd36d49959eab6e9fdb0676ce` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:09.546789 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9731c0cd36d49959eab6e9fdb0676ce)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:09.549904 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:09.605555 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9731c0cd36d49959eab6e9fdb0676ce', 'request_id': 'req-41a75a0f-761e-4f6d-aea5-5fa4106bb650'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.613219 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9731c0cd36d49959eab6e9fdb0676ce', 'request_id': 'req-41a75a0f-761e-4f6d-aea5-5fa4106bb650'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.621296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9731c0cd36d49959eab6e9fdb0676ce', 'request_id': 'req-41a75a0f-761e-4f6d-aea5-5fa4106bb650'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.645096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] The token cache is being invalidate because project d9731c0cd36d49959eab6e9fdb0676ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:48:09.645390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.646036 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.647544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1393/2810] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:48:09 2022] DELETE /identity/v3/projects/d9731c0cd36d49959eab6e9fdb0676ce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:48:09.651889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:09.653291 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:09.667085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52267979-e195-4bab-a5f9-b823750cae6b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:09.716466 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:09.732920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:09.733571 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:09.733853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:09.734131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] PATH_INFO: `/v3/users/5d7ee4f8438b447bb3efbb0fb18f4d2b` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:09.735349 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7ee4f8438b447bb3efbb0fb18f4d2b)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:09.737481 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:09.787427 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7ee4f8438b447bb3efbb0fb18f4d2b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.788114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7ee4f8438b447bb3efbb0fb18f4d2b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.799944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7ee4f8438b447bb3efbb0fb18f4d2b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.807175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7ee4f8438b447bb3efbb0fb18f4d2b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.807895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7ee4f8438b447bb3efbb0fb18f4d2b'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:09.820420 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1418/2811] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:48:09 2022] DELETE /identity/v3/users/5d7ee4f8438b447bb3efbb0fb18f4d2b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:48:09.992683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:09.994171 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:10.009193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a75a0f-761e-4f6d-aea5-5fa4106bb650 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:10.056819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:10.070953 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:10.071743 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:10.072039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:10.072319 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] PATH_INFO: `/v3/projects/c3bcec660e644d51969308598a82ef4f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:10.073488 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bcec660e644d51969308598a82ef4f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:10.075458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:10.128132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bcec660e644d51969308598a82ef4f', 'request_id': 'req-11bf55d1-a629-4e09-97f5-a1e879528417'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:10.134320 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bcec660e644d51969308598a82ef4f', 'request_id': 'req-11bf55d1-a629-4e09-97f5-a1e879528417'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:10.143251 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bcec660e644d51969308598a82ef4f', 'request_id': 'req-11bf55d1-a629-4e09-97f5-a1e879528417'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:10.154466 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] The token cache is being invalidate because project c3bcec660e644d51969308598a82ef4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:48:10.154759 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:10.155780 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:48:10.157266 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1394/2812] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:48:09 2022] DELETE /identity/v3/projects/c3bcec660e644d51969308598a82ef4f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:48:19.816972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:20.151224 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:48:51.262881 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:51.264334 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:51.342588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d08d0-8e5b-4f25-9269-bc10e7745fca admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:51.391270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:51.391847 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:51.392128 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:51.392403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:51.394823 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:51.474318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:51.475794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:51.495636 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1419/2813] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:53.066621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:53.068076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:53.080226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf55d1-a629-4e09-97f5-a1e879528417 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:53.084534 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:53.085142 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:53.085423 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:53.085700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:53.087428 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:53.101263 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:53.102690 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:53.114205 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1395/2814] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:48:57.477673 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:48:57.479097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:57.493122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c754d8-81cd-496b-ac54-476c6e9bb132 service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:48:57.498777 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc87886676534d46bee21984a515c138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:48:57.499713 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:48:57.500006 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:48:57.500286 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:48:57.502318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:48:57.516014 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:48:57.517563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:48:57.537954 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1420/2815] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:03.108846 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:05.586623 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:05.588273 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:05.653884 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64f8c-82dd-41c4-9ab2-1d2f4e3f0935 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:05.658389 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:05.659012 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:05.659314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:05.660371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] PATH_INFO: `/v3/users/78abd968c9634dcdb94a69a7c80a6696` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:05.661648 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=78abd968c9634dcdb94a69a7c80a6696)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:05.663568 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:05.712510 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78abd968c9634dcdb94a69a7c80a6696'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:05.713101 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78abd968c9634dcdb94a69a7c80a6696'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:05.713785 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78abd968c9634dcdb94a69a7c80a6696'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:05.721561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78abd968c9634dcdb94a69a7c80a6696'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:05.734271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c882296d-230a-4520-9bdf-0772c61d7ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78abd968c9634dcdb94a69a7c80a6696'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:05.750040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1396/2816] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:05 2022] DELETE /identity/v3/users/78abd968c9634dcdb94a69a7c80a6696 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:05.932224 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:05.938977 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=100 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:05.943661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28dee3-e985-4cc0-abc7-1b1146742c57 service nova] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.001181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.001818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.002099 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.002375 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] PATH_INFO: `/v3/projects/69bf51b15a434588a21b775161bebd20` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.004223 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bf51b15a434588a21b775161bebd20)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.006134 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.051981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bf51b15a434588a21b775161bebd20', 'request_id': 'req-1b683991-0353-4b5a-b236-99567d33140e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:06.057269 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bf51b15a434588a21b775161bebd20', 'request_id': 'req-1b683991-0353-4b5a-b236-99567d33140e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:06.063181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bf51b15a434588a21b775161bebd20', 'request_id': 'req-1b683991-0353-4b5a-b236-99567d33140e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:06.075940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] The token cache is being invalidate because project 69bf51b15a434588a21b775161bebd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:06.076228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:06.076841 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-1b683991-0353-4b5a-b236-99567d33140e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:06.078292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1421/2817] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:05 2022] DELETE /identity/v3/projects/69bf51b15a434588a21b775161bebd20 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:06.083611 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8caf-5f99-40e9-9613-4b94a3b7eb59 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.083914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8caf-5f99-40e9-9613-4b94a3b7eb59 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.084199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8caf-5f99-40e9-9613-4b94a3b7eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.144463 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-644c8caf-5f99-40e9-9613-4b94a3b7eb59 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:06.145703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-644c8caf-5f99-40e9-9613-4b94a3b7eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:06.188354 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:06.205350 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1397/2818] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 10:49:06.213036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905622-01d2-441a-93c3-f9966c66a391 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.213329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905622-01d2-441a-93c3-f9966c66a391 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.213609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905622-01d2-441a-93c3-f9966c66a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.233114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f9905622-01d2-441a-93c3-f9966c66a391 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:06.234347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f9905622-01d2-441a-93c3-f9966c66a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:06.242937 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1422/2819] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:06.247030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8caf-5f99-40e9-9613-4b94a3b7eb59 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.257764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8caf-5f99-40e9-9613-4b94a3b7eb59 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.262490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.263094 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.263378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.263703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.264361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:49:06.264669 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.266284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.277981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1398/2820] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:49:06.282193 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9905622-01d2-441a-93c3-f9966c66a391 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.291404 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9905622-01d2-441a-93c3-f9966c66a391 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.296064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.296656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.296938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.297213 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.297856 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.299861 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.336473 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1423/2821] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:06 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:06.340480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.350493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae3ea3-2291-4b1b-b6df-d8ea2785c3f7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.406003 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.406647 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.406924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.407199 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.407855 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.410426 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.431005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1399/2822] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:06 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:06.435267 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.445607 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa722c4-a87e-4fb9-86ae-b9ec1a6a40a1 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.450088 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.450670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.450953 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.451225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.451905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.453512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.463144 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1424/2823] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:06.467068 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.477859 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429af292-bea1-4e69-a4de-1b74908de5ac admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.482527 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd07191-9a0b-4e9c-b4ff-70532790856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.483122 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd07191-9a0b-4e9c-b4ff-70532790856f admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.483407 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd07191-9a0b-4e9c-b4ff-70532790856f admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.483716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd07191-9a0b-4e9c-b4ff-70532790856f admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.484358 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd07191-9a0b-4e9c-b4ff-70532790856f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.485950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd07191-9a0b-4e9c-b4ff-70532790856f admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.497162 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1400/2824] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:06.501772 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.511682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95a410-a2d6-4811-b5e3-62cc1dc48e23 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.516136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.516768 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.517047 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.517320 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] PATH_INFO: `/v3/projects/11e5944ddf6c477ab4f56e202d338477/users/f1b94be356e742efb87624b9197a0099/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.531492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e5944ddf6c477ab4f56e202d338477, user_id=f1b94be356e742efb87624b9197a0099, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.534212 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.546860 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1425/2825] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:06 2022] PUT /identity/v3/projects/11e5944ddf6c477ab4f56e202d338477/users/f1b94be356e742efb87624b9197a0099/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:06.557731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7ff2-dee6-470d-8668-4aa871ccdf99 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.558033 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7ff2-dee6-470d-8668-4aa871ccdf99 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.558443 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7ff2-dee6-470d-8668-4aa871ccdf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.586558 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-5c5e7ff2-dee6-470d-8668-4aa871ccdf99 None None] MFA Rules not processed for user `f1b94be356e742efb87624b9197a0099`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:06.587731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5c5e7ff2-dee6-470d-8668-4aa871ccdf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:06.652069 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1401/2826] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:06.656486 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.682949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:06.720467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4bc9-2a97-41d6-9fe7-07bd50077743 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.726494 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.727117 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.727406 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.727695 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.728351 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.730290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.760853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1426/2827] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:06 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:06.765077 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7ff2-dee6-470d-8668-4aa871ccdf99 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.776242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7ff2-dee6-470d-8668-4aa871ccdf99 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.818796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:06.835700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.836316 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.836651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.836876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.837517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.839444 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.862267 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1402/2828] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:06 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:06.866425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.876779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603272-f485-4c19-95f8-0a65d1a19ea4 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.881533 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.882122 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.882398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.882668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.883301 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.884933 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.896010 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1427/2829] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:06.899950 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.910861 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6f704-4347-4d31-af25-ef341c9e6e09 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:06.915559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:06.916270 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:06.916573 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:06.916860 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] PATH_INFO: `/v3/projects/70b1da214f68481d97928af71a540f8a/users/dba8ab2c3c364cc5a95ed133a8b1c85a/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:06.931378 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b1da214f68481d97928af71a540f8a, user_id=dba8ab2c3c364cc5a95ed133a8b1c85a, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:06.934120 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:06.946691 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1403/2830] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:06 2022] PUT /identity/v3/projects/70b1da214f68481d97928af71a540f8a/users/dba8ab2c3c364cc5a95ed133a8b1c85a/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:06.950649 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:06.961422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862adcf2-b69f-4eff-b4bc-47d1169641e4 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:07.016558 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb6907-d6ad-4ca8-be4d-cb58d2053435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:07.017158 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6907-d6ad-4ca8-be4d-cb58d2053435 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:07.017435 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6907-d6ad-4ca8-be4d-cb58d2053435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:07.017705 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6907-d6ad-4ca8-be4d-cb58d2053435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:07.018338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb6907-d6ad-4ca8-be4d-cb58d2053435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:07.020760 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb6907-d6ad-4ca8-be4d-cb58d2053435 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:07.030131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1428/2831] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:07.034240 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:07.045156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d1c7f-9922-420b-baae-f4b71c0026cd admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:07.049817 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:07.050564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:07.050754 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:07.051028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] PATH_INFO: `/v3/projects/70b1da214f68481d97928af71a540f8a/users/dba8ab2c3c364cc5a95ed133a8b1c85a/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:07.052937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b1da214f68481d97928af71a540f8a, user_id=dba8ab2c3c364cc5a95ed133a8b1c85a, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:07.055572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:07.065445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1404/2832] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:07 2022] PUT /identity/v3/projects/70b1da214f68481d97928af71a540f8a/users/dba8ab2c3c364cc5a95ed133a8b1c85a/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:07.076816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:07.077127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:07.077401 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:07.106371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] MFA Rules not processed for user `dba8ab2c3c364cc5a95ed133a8b1c85a`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:07.107492 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:07.176962 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1429/2833] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:07.187446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:07.189169 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:07.246921 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24c042-f4e9-4622-a338-6cb09a459b89 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:07.250714 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:07.251628 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:07.251913 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:07.252183 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:07.262080 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:07.263508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:07.273836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1405/2834] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:07.319093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:07.320553 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:07.333194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be91cc-0a89-4e5c-b6ab-631da2e3beb7 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:07.336863 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6046bb-2a6e-42ac-8c1f-8fdb3d4e4323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:07.337457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6046bb-2a6e-42ac-8c1f-8fdb3d4e4323 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:07.337736 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6046bb-2a6e-42ac-8c1f-8fdb3d4e4323 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:07.338008 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6046bb-2a6e-42ac-8c1f-8fdb3d4e4323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:07.350811 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:07.395519 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6046bb-2a6e-42ac-8c1f-8fdb3d4e4323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:07.396920 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6046bb-2a6e-42ac-8c1f-8fdb3d4e4323 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:07.405816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1430/2835] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:10.710973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:10.773053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f641d-feba-42a6-b5df-bc421c5bba59 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:10.777598 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:10.778226 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:10.778511 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:10.778788 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] PATH_INFO: `/v3/users/f1b94be356e742efb87624b9197a0099` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:10.779943 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b94be356e742efb87624b9197a0099)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:10.781866 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:10.823567 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:10.829096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b94be356e742efb87624b9197a0099'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:10.829838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b94be356e742efb87624b9197a0099'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:10.830680 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b94be356e742efb87624b9197a0099'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:10.838801 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b94be356e742efb87624b9197a0099'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:10.850639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b94be356e742efb87624b9197a0099'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:10.863919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1406/2836] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:10 2022] DELETE /identity/v3/users/f1b94be356e742efb87624b9197a0099 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:10.868810 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765412-a775-466e-af41-13a1c9135122 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:10.869270 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765412-a775-466e-af41-13a1c9135122 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:10.869369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765412-a775-466e-af41-13a1c9135122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:10.888209 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-e6765412-a775-466e-af41-13a1c9135122 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:10.889392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e6765412-a775-466e-af41-13a1c9135122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:10.947422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1431/2837] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:10.957889 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:10.959325 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:11.038371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa677-e64f-460b-bcbf-882b457d08b5 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:11.042126 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:11.042757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:11.043039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:11.043311 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:11.052409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:11.053834 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:11.063096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1407/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:11.328188 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765412-a775-466e-af41-13a1c9135122 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:11.329601 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-e6765412-a775-466e-af41-13a1c9135122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:11.344211 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765412-a775-466e-af41-13a1c9135122 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:11.350598 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:11.351266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:11.351524 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:11.351826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] PATH_INFO: `/v3/projects/11e5944ddf6c477ab4f56e202d338477` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:11.353241 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e5944ddf6c477ab4f56e202d338477)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:11.355131 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:11.402163 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e5944ddf6c477ab4f56e202d338477', 'request_id': 'req-ecc531b7-8e93-4432-9d90-3d95331fefaf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.407958 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e5944ddf6c477ab4f56e202d338477', 'request_id': 'req-ecc531b7-8e93-4432-9d90-3d95331fefaf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.414731 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e5944ddf6c477ab4f56e202d338477', 'request_id': 'req-ecc531b7-8e93-4432-9d90-3d95331fefaf'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.427001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] The token cache is being invalidate because project 11e5944ddf6c477ab4f56e202d338477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:11.427295 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.427970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.429479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1432/2839] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:11 2022] DELETE /identity/v3/projects/11e5944ddf6c477ab4f56e202d338477 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:11.433438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:11.443265 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb485-d2ef-4ac5-b127-06269de5af98 service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:11.498652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:11.499286 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:11.499572 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:11.499880 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] PATH_INFO: `/v3/users/dba8ab2c3c364cc5a95ed133a8b1c85a` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:11.501292 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba8ab2c3c364cc5a95ed133a8b1c85a)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:11.503291 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:11.545029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:11.547672 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba8ab2c3c364cc5a95ed133a8b1c85a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.548343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba8ab2c3c364cc5a95ed133a8b1c85a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.549376 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba8ab2c3c364cc5a95ed133a8b1c85a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.557317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba8ab2c3c364cc5a95ed133a8b1c85a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.569419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-c2fcc83f-de50-4677-877b-0a9907c27d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba8ab2c3c364cc5a95ed133a8b1c85a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:11.582911 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1408/2840] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:11 2022] DELETE /identity/v3/users/dba8ab2c3c364cc5a95ed133a8b1c85a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:11.869428 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:11.870955 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:11.886680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc531b7-8e93-4432-9d90-3d95331fefaf admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:11.927702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:11.948892 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:11.949557 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:11.949840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:11.950118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] PATH_INFO: `/v3/projects/70b1da214f68481d97928af71a540f8a` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:11.951240 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b1da214f68481d97928af71a540f8a)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:11.953201 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.000261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b1da214f68481d97928af71a540f8a', 'request_id': 'req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:12.005944 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b1da214f68481d97928af71a540f8a', 'request_id': 'req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:12.012217 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b1da214f68481d97928af71a540f8a', 'request_id': 'req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:12.024218 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] The token cache is being invalidate because project 70b1da214f68481d97928af71a540f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:12.024509 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:12.025133 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-552fe2d5-a18c-4448-b52b-8c1ea48a0ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:12.026591 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1433/2841] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:11 2022] DELETE /identity/v3/projects/70b1da214f68481d97928af71a540f8a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:12.032216 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2adfd-3bb5-4cb2-bba5-c2d0a0327e99 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.032705 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2adfd-3bb5-4cb2-bba5-c2d0a0327e99 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.032808 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2adfd-3bb5-4cb2-bba5-c2d0a0327e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.053459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-b2f2adfd-3bb5-4cb2-bba5-c2d0a0327e99 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:12.054665 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-b2f2adfd-3bb5-4cb2-bba5-c2d0a0327e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:12.113823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1409/2842] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:12.121583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fed3b-e713-4240-a030-fb0435365af0 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.121871 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fed3b-e713-4240-a030-fb0435365af0 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.122170 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fed3b-e713-4240-a030-fb0435365af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.141989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-d82fed3b-e713-4240-a030-fb0435365af0 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:12.143208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-d82fed3b-e713-4240-a030-fb0435365af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:12.151513 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1434/2843] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:12.155863 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2adfd-3bb5-4cb2-bba5-c2d0a0327e99 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.166233 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2adfd-3bb5-4cb2-bba5-c2d0a0327e99 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.170849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.171449 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.171773 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.172052 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.172700 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:49:12.173026 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.174621 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.186028 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1410/2844] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:49:12.190309 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fed3b-e713-4240-a030-fb0435365af0 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.199800 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fed3b-e713-4240-a030-fb0435365af0 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.204447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.205037 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.205316 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.205588 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.206805 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.208721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.235686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1435/2845] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:12.239828 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.250078 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7eb2a-da3b-4349-8e73-d86958806c32 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.306757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.307361 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.307675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.307954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.308597 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.310522 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.330324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1411/2846] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:49:12.334900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.345707 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d700b2-2f3f-4577-b091-f6a02d63e53b admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.351100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.351747 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.352035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.352343 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.353001 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.354604 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.364739 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1436/2847] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:12.368545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.378945 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c5d6-79a8-4d1d-a91b-d1df37ecb343 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.383528 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2c54-df8e-443a-bea6-e143994fae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.384156 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c54-df8e-443a-bea6-e143994fae03 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.384441 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c54-df8e-443a-bea6-e143994fae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.384721 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2c54-df8e-443a-bea6-e143994fae03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.385364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef2c54-df8e-443a-bea6-e143994fae03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.386967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef2c54-df8e-443a-bea6-e143994fae03 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.398305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1412/2848] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:49:12.402194 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.412595 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445879-fbc4-4b6a-8cb3-12c24c70a199 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.417126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.417803 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.418082 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.418356 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] PATH_INFO: `/v3/projects/e8dbf17d4a0740c5854f41d35b5dcb87/users/410c384e5a244134aee483cfd4445564/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.432685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dbf17d4a0740c5854f41d35b5dcb87, user_id=410c384e5a244134aee483cfd4445564, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.435327 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.448485 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1437/2849] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:12 2022] PUT /identity/v3/projects/e8dbf17d4a0740c5854f41d35b5dcb87/users/410c384e5a244134aee483cfd4445564/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:12.459475 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6927dd-e83c-4677-b18a-19d3a5b62003 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.459798 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6927dd-e83c-4677-b18a-19d3a5b62003 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.460081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6927dd-e83c-4677-b18a-19d3a5b62003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.488193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0f6927dd-e83c-4677-b18a-19d3a5b62003 None None] MFA Rules not processed for user `410c384e5a244134aee483cfd4445564`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:12.489405 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0f6927dd-e83c-4677-b18a-19d3a5b62003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:12.501795 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:12.555058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1413/2850] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:12.559525 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.621228 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07558e-7fdb-4708-b269-0b4a8a21b946 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.626076 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.626680 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.626964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.627239 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.628661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.630583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.641631 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:12.662143 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1438/2851] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:12.663324 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6927dd-e83c-4677-b18a-19d3a5b62003 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.674039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6927dd-e83c-4677-b18a-19d3a5b62003 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.733748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.734359 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.734643 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.734919 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.735550 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.737509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.759960 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1414/2852] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:12.763990 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.775444 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1bdee-9b79-4cd6-b60b-4d74346d701c admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.780129 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.780734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.781015 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.781307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.781925 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.783563 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.794207 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1439/2853] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:49:12.798280 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.809434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa1cd4-f3d9-4e5a-b52a-37a67e860574 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.814044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.814688 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.814968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.815243 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] PATH_INFO: `/v3/projects/b901ed9243a0412db1407b1166a92bc8/users/5ccd4cb1a36d45f7aa625b91303a6e65/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.830440 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b901ed9243a0412db1407b1166a92bc8, user_id=5ccd4cb1a36d45f7aa625b91303a6e65, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.833504 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.845730 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1415/2854] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:12 2022] PUT /identity/v3/projects/b901ed9243a0412db1407b1166a92bc8/users/5ccd4cb1a36d45f7aa625b91303a6e65/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:12.850109 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.859900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e1b1-049f-42ed-afa3-755a74b64f9d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.917690 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e0382-0a55-4a41-a7d8-3c61cd6fb741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.918336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0382-0a55-4a41-a7d8-3c61cd6fb741 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.918536 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0382-0a55-4a41-a7d8-3c61cd6fb741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.918816 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0382-0a55-4a41-a7d8-3c61cd6fb741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.919462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e0382-0a55-4a41-a7d8-3c61cd6fb741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.921114 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e0382-0a55-4a41-a7d8-3c61cd6fb741 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.931260 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1440/2855] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:12.935402 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:12.946411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f94b43-eda6-4ca2-88d8-3534a734f6a9 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:12.951092 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:12.951779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.952065 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.952340 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] PATH_INFO: `/v3/projects/b901ed9243a0412db1407b1166a92bc8/users/5ccd4cb1a36d45f7aa625b91303a6e65/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:12.954258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b901ed9243a0412db1407b1166a92bc8, user_id=5ccd4cb1a36d45f7aa625b91303a6e65, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:12.957180 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:12.967260 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1416/2856] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:12 2022] PUT /identity/v3/projects/b901ed9243a0412db1407b1166a92bc8/users/5ccd4cb1a36d45f7aa625b91303a6e65/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:12.978453 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5fb0-48cb-45dd-a4df-32ea5eff5601 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:12.978740 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5fb0-48cb-45dd-a4df-32ea5eff5601 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:12.979017 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5fb0-48cb-45dd-a4df-32ea5eff5601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:13.007564 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-755e5fb0-48cb-45dd-a4df-32ea5eff5601 None None] MFA Rules not processed for user `5ccd4cb1a36d45f7aa625b91303a6e65`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:13.008794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-755e5fb0-48cb-45dd-a4df-32ea5eff5601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:13.075779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1441/2857] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:13.086509 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:13.088269 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:13.151174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c7036-669c-4cb2-8cff-5e1fa1c980c0 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:13.154760 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:13.155364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:13.155685 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:13.155962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:13.165722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:13.167185 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:13.177294 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1417/2858] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:13 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:13.253502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5fb0-48cb-45dd-a4df-32ea5eff5601 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:13.263127 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5fb0-48cb-45dd-a4df-32ea5eff5601 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:13.266888 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef752f0-5d05-4420-adfb-ebc7ea06c239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:13.267502 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef752f0-5d05-4420-adfb-ebc7ea06c239 service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:13.267825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef752f0-5d05-4420-adfb-ebc7ea06c239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:13.268091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef752f0-5d05-4420-adfb-ebc7ea06c239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:13.324709 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef752f0-5d05-4420-adfb-ebc7ea06c239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:13.326154 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef752f0-5d05-4420-adfb-ebc7ea06c239 service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:13.330721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:13.336412 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1442/2859] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:13 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:17.449618 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:17.462335 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:17.511926 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c274973-4c69-4aaf-90d9-cb11db7bf170 service cinder] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:17.516445 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:17.517067 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:17.517349 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:17.517625 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] PATH_INFO: `/v3/users/410c384e5a244134aee483cfd4445564` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:17.518733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410c384e5a244134aee483cfd4445564)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:17.521223 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:17.565644 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410c384e5a244134aee483cfd4445564'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:17.566312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410c384e5a244134aee483cfd4445564'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:17.566937 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410c384e5a244134aee483cfd4445564'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:17.574184 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410c384e5a244134aee483cfd4445564'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:17.586571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410c384e5a244134aee483cfd4445564'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:17.599830 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1418/2860] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:17 2022] DELETE /identity/v3/users/410c384e5a244134aee483cfd4445564 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:17.604243 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:17.604738 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:17.604840 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:17.625103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:17.626578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:17.685529 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1443/2861] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:17.695165 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:17.696592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:17.755823 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fd9fa-9bb9-432c-a2a3-891be2e06d32 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:17.759487 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:17.760119 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:17.760454 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:17.760736 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:17.769692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:17.771116 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:17.780575 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1419/2862] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:18.050778 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:18.052622 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:18.064853 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8857-22bf-4b91-b92d-e6ef5ad7f862 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:18.069982 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:18.070656 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:18.070993 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:18.071276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] PATH_INFO: `/v3/projects/e8dbf17d4a0740c5854f41d35b5dcb87` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:18.072477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dbf17d4a0740c5854f41d35b5dcb87)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:18.074510 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:18.125797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dbf17d4a0740c5854f41d35b5dcb87', 'request_id': 'req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.131721 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dbf17d4a0740c5854f41d35b5dcb87', 'request_id': 'req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.137845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dbf17d4a0740c5854f41d35b5dcb87', 'request_id': 'req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.151463 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] The token cache is being invalidate because project e8dbf17d4a0740c5854f41d35b5dcb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:18.151907 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.152537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.154021 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1444/2863] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:18 2022] DELETE /identity/v3/projects/e8dbf17d4a0740c5854f41d35b5dcb87 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:18.158925 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:18.169309 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b793-72ac-44db-a168-6557fb463e5a service neutron] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:18.198968 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:18.227424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:18.228082 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:18.228366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:18.228642 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] PATH_INFO: `/v3/users/5ccd4cb1a36d45f7aa625b91303a6e65` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:18.229761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccd4cb1a36d45f7aa625b91303a6e65)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:18.231725 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:18.275978 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccd4cb1a36d45f7aa625b91303a6e65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.276620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccd4cb1a36d45f7aa625b91303a6e65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.277218 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccd4cb1a36d45f7aa625b91303a6e65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.284010 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccd4cb1a36d45f7aa625b91303a6e65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.296222 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b7b0eccb-7999-4903-8378-8f105abe8c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccd4cb1a36d45f7aa625b91303a6e65'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.308920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1420/2864] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:18 2022] DELETE /identity/v3/users/5ccd4cb1a36d45f7aa625b91303a6e65 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:49:18.576551 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:18.578072 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:18.594032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eee9b2-6e5a-4a5e-845a-76a75ed83048 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:18.651735 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:18.652508 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:18.652665 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:18.652938 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] PATH_INFO: `/v3/projects/b901ed9243a0412db1407b1166a92bc8` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:18.654080 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b901ed9243a0412db1407b1166a92bc8)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:18.656073 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:18.685388 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:18.704535 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b901ed9243a0412db1407b1166a92bc8', 'request_id': 'req-003a9a63-4fc8-41db-b09a-f09983af6457'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.710702 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b901ed9243a0412db1407b1166a92bc8', 'request_id': 'req-003a9a63-4fc8-41db-b09a-f09983af6457'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.718065 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b901ed9243a0412db1407b1166a92bc8', 'request_id': 'req-003a9a63-4fc8-41db-b09a-f09983af6457'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.732424 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] The token cache is being invalidate because project b901ed9243a0412db1407b1166a92bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:18.732715 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.733338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-003a9a63-4fc8-41db-b09a-f09983af6457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:18.734817 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1445/2865] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:18 2022] DELETE /identity/v3/projects/b901ed9243a0412db1407b1166a92bc8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:18.740384 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f4a3-d10d-4aea-8c76-c6ac5632e8d7 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:18.740881 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f4a3-d10d-4aea-8c76-c6ac5632e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:18.740995 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1f4a3-d10d-4aea-8c76-c6ac5632e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:18.761627 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fff1f4a3-d10d-4aea-8c76-c6ac5632e8d7 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:18.762838 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fff1f4a3-d10d-4aea-8c76-c6ac5632e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:18.821225 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1421/2866] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:18.829005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00541-c1bb-412f-a00c-41ce004749bd None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:18.829292 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00541-c1bb-412f-a00c-41ce004749bd None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:18.829570 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e00541-c1bb-412f-a00c-41ce004749bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:18.849431 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-f4e00541-c1bb-412f-a00c-41ce004749bd None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:18.850635 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f4e00541-c1bb-412f-a00c-41ce004749bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:18.858425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1446/2867] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:18.862640 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f4a3-d10d-4aea-8c76-c6ac5632e8d7 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:18.873039 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1f4a3-d10d-4aea-8c76-c6ac5632e8d7 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:18.877909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:18.878508 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:18.878794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:18.879673 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] PATH_INFO: `/v3/domains` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:18.880282 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:49:18.880592 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:18.882194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:18.893588 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1422/2868] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:49:18.897882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00541-c1bb-412f-a00c-41ce004749bd None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:18.907197 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e00541-c1bb-412f-a00c-41ce004749bd None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:18.913104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:18.913725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:18.914091 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:18.914457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:18.915098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:18.916922 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:18.945054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1447/2869] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:18 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:18.949268 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:18.959616 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e023c73-da6e-4bf1-8fa1-d8697cdec00a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:18.997285 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:19.019107 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.019932 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.020333 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.020720 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.021472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.023490 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.043918 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1423/2870] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:18 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:19.047963 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.058639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd861-ca76-44fe-b99e-1e3f83964d62 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.063273 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.063901 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.064180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.064451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.065085 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.067307 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.076968 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1448/2871] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:19.080786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.090923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c138d54-bd60-4ccc-bba1-4e5aafe6acad admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.095538 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0cc1a-882b-4770-9f88-a4265e39561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.096178 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cc1a-882b-4770-9f88-a4265e39561c admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.096461 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cc1a-882b-4770-9f88-a4265e39561c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.096737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cc1a-882b-4770-9f88-a4265e39561c admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.097380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0cc1a-882b-4770-9f88-a4265e39561c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.099058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0cc1a-882b-4770-9f88-a4265e39561c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.108979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1424/2872] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:19.113248 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.124254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490c76c-f7a1-4cb7-976e-57297eed9ffc admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.129868 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.130523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.130796 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.131068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] PATH_INFO: `/v3/projects/0daf002d661a4b32b49bcad478331c78/users/39d88ceee6cc40e3a232e097c2832ca3/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.145678 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0daf002d661a4b32b49bcad478331c78, user_id=39d88ceee6cc40e3a232e097c2832ca3, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.148366 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.161972 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1449/2873] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:19 2022] PUT /identity/v3/projects/0daf002d661a4b32b49bcad478331c78/users/39d88ceee6cc40e3a232e097c2832ca3/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:19.173448 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96941c12-0660-45aa-9499-dad85aca3393 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.173741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96941c12-0660-45aa-9499-dad85aca3393 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.174022 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96941c12-0660-45aa-9499-dad85aca3393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.202139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-96941c12-0660-45aa-9499-dad85aca3393 None None] MFA Rules not processed for user `39d88ceee6cc40e3a232e097c2832ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:19.203347 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-96941c12-0660-45aa-9499-dad85aca3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:19.269030 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1425/2874] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:19.273561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.344284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24890ea-aa1b-4490-9ac7-21a5fdcf3309 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.350347 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.350961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.351242 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.351514 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.352177 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.354103 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.380899 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1450/2875] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:19 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:19.384972 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96941c12-0660-45aa-9499-dad85aca3393 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.395876 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96941c12-0660-45aa-9499-dad85aca3393 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.451005 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.451634 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.451971 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.452244 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.452867 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.454783 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.475242 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1426/2876] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:19 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:19.479175 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.489883 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ddec-1f9b-4cb1-afee-9617a4a27942 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.494438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.495032 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.495315 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.495618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.496266 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.497870 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.508479 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1451/2877] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:19.512484 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.523095 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ca19a-a23e-4340-936b-7a6281cf58d2 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.527547 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.528213 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.528492 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.528786 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] PATH_INFO: `/v3/projects/9ce397d1d63646688d2f8a49bcb1ff93/users/9b9f946cf613419bad991f7748084bd6/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.544047 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce397d1d63646688d2f8a49bcb1ff93, user_id=9b9f946cf613419bad991f7748084bd6, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.546696 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.559570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1427/2878] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:19 2022] PUT /identity/v3/projects/9ce397d1d63646688d2f8a49bcb1ff93/users/9b9f946cf613419bad991f7748084bd6/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:19.563409 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.573620 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c841ddb-6b33-4006-bcad-83af17dfe712 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.594094 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:19.632060 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9c60c-f83a-44b2-a79d-ac25071dd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.632669 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9c60c-f83a-44b2-a79d-ac25071dd0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.632969 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9c60c-f83a-44b2-a79d-ac25071dd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.633231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9c60c-f83a-44b2-a79d-ac25071dd0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.633864 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9c60c-f83a-44b2-a79d-ac25071dd0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.635458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9c60c-f83a-44b2-a79d-ac25071dd0c9 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.645573 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1452/2879] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:19.649741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.659967 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be05b92-6512-43de-870c-37dda38a2469 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.665133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.665873 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.666151 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.666422 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] PATH_INFO: `/v3/projects/9ce397d1d63646688d2f8a49bcb1ff93/users/9b9f946cf613419bad991f7748084bd6/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.668290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce397d1d63646688d2f8a49bcb1ff93, user_id=9b9f946cf613419bad991f7748084bd6, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.670923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.677015 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:19.681723 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1428/2880] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:19 2022] PUT /identity/v3/projects/9ce397d1d63646688d2f8a49bcb1ff93/users/9b9f946cf613419bad991f7748084bd6/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:19.745300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e676-b5e7-4acf-9642-6988f5fcd8f4 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.745905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e676-b5e7-4acf-9642-6988f5fcd8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.745905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e676-b5e7-4acf-9642-6988f5fcd8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.774386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-69c3e676-b5e7-4acf-9642-6988f5fcd8f4 None None] MFA Rules not processed for user `9b9f946cf613419bad991f7748084bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:19.775547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-69c3e676-b5e7-4acf-9642-6988f5fcd8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:19.843025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1453/2881] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:19.853811 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:19.855579 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:19.914499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c769ec-b2d7-430e-b723-117e08cc4203 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:19.918105 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5bf16-dc2a-4425-aa22-ecc36ccedff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:19.918702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5bf16-dc2a-4425-aa22-ecc36ccedff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:19.918979 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5bf16-dc2a-4425-aa22-ecc36ccedff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:19.919250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5bf16-dc2a-4425-aa22-ecc36ccedff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:19.928748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5bf16-dc2a-4425-aa22-ecc36ccedff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:19.930174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5bf16-dc2a-4425-aa22-ecc36ccedff1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:19.939544 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1429/2882] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:20.074126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3e676-b5e7-4acf-9642-6988f5fcd8f4 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:20.136618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3e676-b5e7-4acf-9642-6988f5fcd8f4 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:20.141105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:20.141733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:20.142011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:20.142287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] PATH_INFO: `/v3/users/39d88ceee6cc40e3a232e097c2832ca3` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:20.143422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d88ceee6cc40e3a232e097c2832ca3)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:20.146007 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:20.189976 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d88ceee6cc40e3a232e097c2832ca3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.190643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d88ceee6cc40e3a232e097c2832ca3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.192332 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:20.204318 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d88ceee6cc40e3a232e097c2832ca3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.211939 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d88ceee6cc40e3a232e097c2832ca3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.212586 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d88ceee6cc40e3a232e097c2832ca3'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.224617 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1454/2883] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:20 2022] DELETE /identity/v3/users/39d88ceee6cc40e3a232e097c2832ca3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:20.229056 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:20.229348 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:20.229652 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:20.248796 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:20.250044 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:20.310766 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1430/2884] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:20.321036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:20.322461 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:20.380744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ba7fe-21f5-452d-a039-72a63c02f34e admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:20.384632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:20.385231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:20.385670 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:20.385949 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:20.396197 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:20.397642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:20.407205 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1455/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:20.682761 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:20.684245 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:20.697829 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cf277-ff9c-4978-a8ff-f84c6fd39e70 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:20.702641 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:20.703284 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:20.703570 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:20.703882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] PATH_INFO: `/v3/projects/0daf002d661a4b32b49bcad478331c78` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:20.705670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0daf002d661a4b32b49bcad478331c78)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:20.707731 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:20.756779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0daf002d661a4b32b49bcad478331c78', 'request_id': 'req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.762976 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0daf002d661a4b32b49bcad478331c78', 'request_id': 'req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.770262 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0daf002d661a4b32b49bcad478331c78', 'request_id': 'req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.780410 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] The token cache is being invalidate because project 0daf002d661a4b32b49bcad478331c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:20.780702 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.781329 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.782812 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1431/2886] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:20 2022] DELETE /identity/v3/projects/0daf002d661a4b32b49bcad478331c78 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:20.787451 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:20.796889 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281eaf9-09a0-4dee-95fe-b5335eb8ad48 service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:20.864402 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:20.864948 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:20.865225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:20.865497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] PATH_INFO: `/v3/users/9b9f946cf613419bad991f7748084bd6` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:20.866606 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9f946cf613419bad991f7748084bd6)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:20.868559 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:20.913528 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9f946cf613419bad991f7748084bd6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.914171 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9f946cf613419bad991f7748084bd6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.927168 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9f946cf613419bad991f7748084bd6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.930754 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:20.934454 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9f946cf613419bad991f7748084bd6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.935505 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-6f3d4807-9e3a-483f-b04d-e97c529ebaa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9f946cf613419bad991f7748084bd6'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:20.948917 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1456/2887] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:20 2022] DELETE /identity/v3/users/9b9f946cf613419bad991f7748084bd6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:21.218784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.220287 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:21.234296 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe695f-1233-4cdd-abd8-c4a04f9885b3 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.260629 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:21.294517 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.295146 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.295424 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.295734 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] PATH_INFO: `/v3/projects/9ce397d1d63646688d2f8a49bcb1ff93` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.296858 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce397d1d63646688d2f8a49bcb1ff93)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.298805 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:21.344578 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce397d1d63646688d2f8a49bcb1ff93', 'request_id': 'req-cf7e0549-3b6e-4556-ad98-d09cf335036d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:21.351114 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce397d1d63646688d2f8a49bcb1ff93', 'request_id': 'req-cf7e0549-3b6e-4556-ad98-d09cf335036d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:21.357988 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce397d1d63646688d2f8a49bcb1ff93', 'request_id': 'req-cf7e0549-3b6e-4556-ad98-d09cf335036d'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:21.369072 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] The token cache is being invalidate because project 9ce397d1d63646688d2f8a49bcb1ff93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:21.369521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:21.370271 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-cf7e0549-3b6e-4556-ad98-d09cf335036d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:21.371989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1432/2888] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:21 2022] DELETE /identity/v3/projects/9ce397d1d63646688d2f8a49bcb1ff93 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:49:21.377152 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7339-74aa-420c-be96-449b52e6df5f None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.377474 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7339-74aa-420c-be96-449b52e6df5f None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.377812 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7339-74aa-420c-be96-449b52e6df5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.398105 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2e1a7339-74aa-420c-be96-449b52e6df5f None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:21.399296 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2e1a7339-74aa-420c-be96-449b52e6df5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:21.458011 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1457/2889] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:21.465525 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0742fa-6f7d-41dc-9ce5-74049ec2a5c1 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.465816 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0742fa-6f7d-41dc-9ce5-74049ec2a5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.466102 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0742fa-6f7d-41dc-9ce5-74049ec2a5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.487123 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fd0742fa-6f7d-41dc-9ce5-74049ec2a5c1 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:21.488458 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fd0742fa-6f7d-41dc-9ce5-74049ec2a5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:21.496678 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1433/2890] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:21.500981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7339-74aa-420c-be96-449b52e6df5f None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.512183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7339-74aa-420c-be96-449b52e6df5f None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.516876 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.517476 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.517759 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.518033 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.518683 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:49:21.519113 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.521339 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:21.533458 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1458/2891] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:49:21.537905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0742fa-6f7d-41dc-9ce5-74049ec2a5c1 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.547307 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0742fa-6f7d-41dc-9ce5-74049ec2a5c1 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.552380 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.552994 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.553276 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.553551 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.554200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.556138 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:21.586058 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1434/2892] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:21 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:21.590208 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.600970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6333a-f455-49d5-8bd5-e91ac33d0ef3 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.660689 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.661202 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.661483 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.661787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.662423 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.665100 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:21.687054 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1459/2893] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:21 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:21.691413 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.702849 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec743ed-b1ad-44da-bbd4-53de4387452c admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.708543 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.709153 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.709436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.709716 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.710372 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.712024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:21.723933 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1435/2894] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:21.728336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.738895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce509d1-d617-4324-b77e-5c290d8e5011 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.743830 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4bb36-c27d-4ae0-bc6c-88cd4cc80229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.744440 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4bb36-c27d-4ae0-bc6c-88cd4cc80229 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.744751 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4bb36-c27d-4ae0-bc6c-88cd4cc80229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.745028 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4bb36-c27d-4ae0-bc6c-88cd4cc80229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.745686 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4bb36-c27d-4ae0-bc6c-88cd4cc80229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.747277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4bb36-c27d-4ae0-bc6c-88cd4cc80229 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:21.758845 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1460/2895] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:21.763070 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.773989 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ecf54-64f2-450c-b6d2-cda64561a693 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.778513 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.779160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.779438 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.779755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] PATH_INFO: `/v3/projects/f5fc821eccd94a93bd0fbf7edb3e159f/users/bf165c88c1874d80ad7192b5c0c0729e/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.795480 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fc821eccd94a93bd0fbf7edb3e159f, user_id=bf165c88c1874d80ad7192b5c0c0729e, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.798172 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:21.811453 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1436/2896] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:21 2022] PUT /identity/v3/projects/f5fc821eccd94a93bd0fbf7edb3e159f/users/bf165c88c1874d80ad7192b5c0c0729e/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:21.823941 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5637c-5643-445b-87ed-07f768fc9986 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.824422 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5637c-5643-445b-87ed-07f768fc9986 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.824544 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5637c-5643-445b-87ed-07f768fc9986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.852872 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-c5e5637c-5643-445b-87ed-07f768fc9986 None None] MFA Rules not processed for user `bf165c88c1874d80ad7192b5c0c0729e`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:21.854079 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c5e5637c-5643-445b-87ed-07f768fc9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:21.895857 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:21.919314 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1461/2897] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:21.923755 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:21.975411 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:21.985698 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773bc40-fbcc-4d98-8e2a-e06fd39d3116 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:21.991963 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:21.992589 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:21.992870 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:21.993145 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:21.993784 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:21.995722 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:22.022977 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1437/2898] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:21 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:22.026931 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5637c-5643-445b-87ed-07f768fc9986 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:22.037851 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5637c-5643-445b-87ed-07f768fc9986 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:22.094512 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:22.095120 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:22.095397 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:22.095703 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:22.096341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:22.098561 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:22.119425 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1462/2899] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:22 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:22.123536 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:22.134908 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3765291-e034-4e7d-a47e-2f6b9fdefc6a admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:22.139446 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:22.140075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:22.140352 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:22.140620 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:22.141256 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:22.142841 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:22.153373 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1438/2900] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:49:22.157540 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:22.167833 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9b562-1dec-4680-ac3f-fe3447d60a89 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:22.172405 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:22.172981 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:22.173261 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:22.173537 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] PATH_INFO: `/v3/projects/41bbcecccf234139bb03869d432c6ac3/users/58cd66b15c18450db0984747c1ba944d/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:22.188297 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bbcecccf234139bb03869d432c6ac3, user_id=58cd66b15c18450db0984747c1ba944d, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:22.190934 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:22.203578 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1463/2901] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:22 2022] PUT /identity/v3/projects/41bbcecccf234139bb03869d432c6ac3/users/58cd66b15c18450db0984747c1ba944d/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:22.207735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:22.217519 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c809805-7900-4ad1-8ec4-08987b038fb7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:22.274839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7a6ee-8239-4d47-bda8-a3e0d6d2d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:22.275472 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a6ee-8239-4d47-bda8-a3e0d6d2d88b admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:22.275741 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a6ee-8239-4d47-bda8-a3e0d6d2d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:22.276013 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7a6ee-8239-4d47-bda8-a3e0d6d2d88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:22.276639 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7a6ee-8239-4d47-bda8-a3e0d6d2d88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:22.278253 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7a6ee-8239-4d47-bda8-a3e0d6d2d88b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:22.288735 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1439/2902] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 10:49:22.292989 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:22.303970 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4a47e-1ace-4537-8408-b63f36455eb5 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:22.308542 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:22.309185 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:22.309462 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:22.309733 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] PATH_INFO: `/v3/projects/41bbcecccf234139bb03869d432c6ac3/users/58cd66b15c18450db0984747c1ba944d/roles/6df474b0ef494105b42c9715d6b2fb78` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:22.311639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bbcecccf234139bb03869d432c6ac3, user_id=58cd66b15c18450db0984747c1ba944d, role_id=6df474b0ef494105b42c9715d6b2fb78)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:22.314256 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:22.324426 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1464/2903] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:22 2022] PUT /identity/v3/projects/41bbcecccf234139bb03869d432c6ac3/users/58cd66b15c18450db0984747c1ba944d/roles/6df474b0ef494105b42c9715d6b2fb78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:22.334305 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:22.334670 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:22.334948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:22.363390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] MFA Rules not processed for user `58cd66b15c18450db0984747c1ba944d`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:22.365118 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:22.432027 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1440/2904] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:22.443346 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:22.445098 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:22.503583 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62355e-b9b5-4c65-aeef-21ae2bf29be2 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:22.507477 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:22.508104 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:22.508386 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:22.508661 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:22.559515 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:22.571196 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:22.572906 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:22.583049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1465/2905] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:26.836920 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:26.838434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:26.850450 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f157cc8-fa78-450e-afae-3884e37b84f5 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:26.853954 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f84af5-e770-47e3-9e7e-1e9cf72f32b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:26.854545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f84af5-e770-47e3-9e7e-1e9cf72f32b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:26.854824 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f84af5-e770-47e3-9e7e-1e9cf72f32b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:26.855096 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f84af5-e770-47e3-9e7e-1e9cf72f32b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:26.864552 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f84af5-e770-47e3-9e7e-1e9cf72f32b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:26.866227 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f84af5-e770-47e3-9e7e-1e9cf72f32b1 service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:26.875732 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1441/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:31.762929 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:31.826192 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f55399-6e67-4b27-8d2a-0175321976ac service cinder] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:31.830714 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:31.831338 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:31.831642 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:31.831923 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] PATH_INFO: `/v3/users/bf165c88c1874d80ad7192b5c0c0729e` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:31.833030 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf165c88c1874d80ad7192b5c0c0729e)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:31.835147 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:31.881447 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf165c88c1874d80ad7192b5c0c0729e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:31.882092 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf165c88c1874d80ad7192b5c0c0729e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:31.893813 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf165c88c1874d80ad7192b5c0c0729e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:31.901682 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf165c88c1874d80ad7192b5c0c0729e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:31.902294 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf165c88c1874d80ad7192b5c0c0729e'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:31.914998 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1466/2907] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:31 2022] DELETE /identity/v3/users/bf165c88c1874d80ad7192b5c0c0729e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:31.919520 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:31.920024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:31.920139 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:31.939753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:31.940948 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:31.970681 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:32.000300 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1442/2908] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:32.010725 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:32.012179 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:32.068590 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43887c3-bed3-4871-8ed4-bc7856b150f0 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:32.072254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:32.072855 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:32.073136 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:32.073411 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:32.082438 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:32.084523 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:32.094300 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1467/2909] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:32.363521 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:32.365041 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:32.380090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b5368-e342-4432-a34c-0755c179ae9c None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:32.385398 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:32.386032 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:32.386312 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:32.386587 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] PATH_INFO: `/v3/projects/f5fc821eccd94a93bd0fbf7edb3e159f` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:32.387779 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fc821eccd94a93bd0fbf7edb3e159f)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:32.389708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:32.436330 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fc821eccd94a93bd0fbf7edb3e159f', 'request_id': 'req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.442369 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fc821eccd94a93bd0fbf7edb3e159f', 'request_id': 'req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.449985 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fc821eccd94a93bd0fbf7edb3e159f', 'request_id': 'req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.460897 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] The token cache is being invalidate because project f5fc821eccd94a93bd0fbf7edb3e159f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:32.461181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.461794 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.463252 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1443/2910] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:32 2022] DELETE /identity/v3/projects/f5fc821eccd94a93bd0fbf7edb3e159f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:32.467221 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:32.477005 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0b14c-fc73-4caa-ab10-e975cfdae83b service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:32.484685 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:32.537430 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:32.538107 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:32.538335 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:32.538609 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] PATH_INFO: `/v3/users/58cd66b15c18450db0984747c1ba944d` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:32.539765 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58cd66b15c18450db0984747c1ba944d)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:32.541905 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:32.595026 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58cd66b15c18450db0984747c1ba944d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.595734 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58cd66b15c18450db0984747c1ba944d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.608035 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58cd66b15c18450db0984747c1ba944d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.616277 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58cd66b15c18450db0984747c1ba944d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.616890 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-2f2bd3ca-aa65-4b2f-af42-54bb4c0c8df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58cd66b15c18450db0984747c1ba944d'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:32.629677 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1468/2911] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:32 2022] DELETE /identity/v3/users/58cd66b15c18450db0984747c1ba944d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:32.898473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:32.900053 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:32.913923 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dc4b2-2486-49b3-81c8-cac62ebad3af admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:32.972658 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:32.973360 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:32.973559 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:32.973832 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] PATH_INFO: `/v3/projects/41bbcecccf234139bb03869d432c6ac3` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:32.975193 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bbcecccf234139bb03869d432c6ac3)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:32.977128 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.023577 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bbcecccf234139bb03869d432c6ac3', 'request_id': 'req-ca861286-dc91-4ac6-91bc-223af01a0d3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.029662 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bbcecccf234139bb03869d432c6ac3', 'request_id': 'req-ca861286-dc91-4ac6-91bc-223af01a0d3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.037409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bbcecccf234139bb03869d432c6ac3', 'request_id': 'req-ca861286-dc91-4ac6-91bc-223af01a0d3a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.038651 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:33.050571 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] The token cache is being invalidate because project 41bbcecccf234139bb03869d432c6ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:33.050869 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.051493 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-ca861286-dc91-4ac6-91bc-223af01a0d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.053768 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1444/2912] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:32 2022] DELETE /identity/v3/projects/41bbcecccf234139bb03869d432c6ac3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:49:33.059637 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7486d7-8a19-4391-b6f8-f09f58916006 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.060118 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7486d7-8a19-4391-b6f8-f09f58916006 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.060226 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7486d7-8a19-4391-b6f8-f09f58916006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.079657 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-2f7486d7-8a19-4391-b6f8-f09f58916006 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:33.080797 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-2f7486d7-8a19-4391-b6f8-f09f58916006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:33.145452 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1469/2913] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:33.154196 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33b4a6-113d-46c8-bfbb-1253e43e0245 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.154506 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33b4a6-113d-46c8-bfbb-1253e43e0245 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.154767 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33b4a6-113d-46c8-bfbb-1253e43e0245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.175258 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-fa33b4a6-113d-46c8-bfbb-1253e43e0245 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:33.176564 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-fa33b4a6-113d-46c8-bfbb-1253e43e0245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:33.185187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1445/2914] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:33.189541 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7486d7-8a19-4391-b6f8-f09f58916006 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.199668 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7486d7-8a19-4391-b6f8-f09f58916006 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.204231 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.204818 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.205093 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.205365 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.206036 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:49:33.206336 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.207965 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.219289 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1470/2915] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 10:49:33.223582 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33b4a6-113d-46c8-bfbb-1253e43e0245 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.233599 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33b4a6-113d-46c8-bfbb-1253e43e0245 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.238317 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.238914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.239200 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.239479 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.240802 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.242748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.271500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1446/2916] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:33 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 10:49:33.275615 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.285646 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5a1ce-ca35-413e-bc83-bf1ffbf28cfe admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.298398 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:33.342940 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.343467 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.343781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.344058 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.344724 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.346652 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.369138 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1471/2917] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:33 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:33.373237 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.383708 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d15c-2c79-4426-a1f6-302d3b9cfc47 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.388290 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.388878 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.389161 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.389434 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.390076 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.391717 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.402021 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1447/2918] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:33.405865 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.416769 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56973-e6de-4b0d-b5df-1f65bf459e59 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.421373 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bb703-3e7b-4c05-bd80-b862cf7031f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.421959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bb703-3e7b-4c05-bd80-b862cf7031f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.422236 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bb703-3e7b-4c05-bd80-b862cf7031f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.422507 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bb703-3e7b-4c05-bd80-b862cf7031f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.423169 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bb703-3e7b-4c05-bd80-b862cf7031f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.424789 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bb703-3e7b-4c05-bd80-b862cf7031f8 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.435555 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1472/2919] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:33.439561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.450497 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c178cc-7476-4cbe-b711-88c2dc6e8ce7 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.455132 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.455804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.456090 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.456366 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] PATH_INFO: `/v3/projects/8ab549dc313847c39c994e30d7658741/users/e41a9b4962254874842e756005bcd897/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.471905 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab549dc313847c39c994e30d7658741, user_id=e41a9b4962254874842e756005bcd897, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.475381 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.487892 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1448/2920] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:33 2022] PUT /identity/v3/projects/8ab549dc313847c39c994e30d7658741/users/e41a9b4962254874842e756005bcd897/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:33.500331 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1397b2-ee00-4ad9-a4f2-5899a568c296 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.500618 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1397b2-ee00-4ad9-a4f2-5899a568c296 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.500895 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1397b2-ee00-4ad9-a4f2-5899a568c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.529284 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-9a1397b2-ee00-4ad9-a4f2-5899a568c296 None None] MFA Rules not processed for user `e41a9b4962254874842e756005bcd897`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:33.530475 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-9a1397b2-ee00-4ad9-a4f2-5899a568c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:33.594041 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1473/2921] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:33.605882 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.607545 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:33.664432 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637959-01ed-49ec-9ac5-a70d0614d07b admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.668037 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb5fa9-1df4-4fa2-8626-887d92d5e25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0621adefc6b340eba1ce85a4f64cae25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.668635 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5fa9-1df4-4fa2-8626-887d92d5e25b service cinder] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.668914 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5fa9-1df4-4fa2-8626-887d92d5e25b service cinder] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.669181 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb5fa9-1df4-4fa2-8626-887d92d5e25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.677439 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb5fa9-1df4-4fa2-8626-887d92d5e25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.679049 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb5fa9-1df4-4fa2-8626-887d92d5e25b service cinder] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.688042 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1449/2922] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:33.710413 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1397b2-ee00-4ad9-a4f2-5899a568c296 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.774414 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1397b2-ee00-4ad9-a4f2-5899a568c296 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:33.779016 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:33.779676 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.779964 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.780246 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] PATH_INFO: `/v3/users/e41a9b4962254874842e756005bcd897` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.781382 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41a9b4962254874842e756005bcd897)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:33.783329 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:33.812643 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:33.833031 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41a9b4962254874842e756005bcd897'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.833824 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41a9b4962254874842e756005bcd897'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.846311 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41a9b4962254874842e756005bcd897'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.853550 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41a9b4962254874842e756005bcd897'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.854229 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41a9b4962254874842e756005bcd897'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:33.866371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1474/2923] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:33 2022] DELETE /identity/v3/users/e41a9b4962254874842e756005bcd897 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:33.870962 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:33.871250 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:33.871529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:33.891147 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:33.892390 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:33.950115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1450/2924] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:33.960961 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:33.962358 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:34.018814 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7e471-1cad-4b8b-a362-6b2a909f8a46 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.023123 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554341f-5e27-4625-9f21-ec2359794e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.023767 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554341f-5e27-4625-9f21-ec2359794e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.024052 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554341f-5e27-4625-9f21-ec2359794e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.024352 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554341f-5e27-4625-9f21-ec2359794e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.033181 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554341f-5e27-4625-9f21-ec2359794e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.034627 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554341f-5e27-4625-9f21-ec2359794e33 service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.044064 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1475/2925] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:34.308499 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.310081 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:34.323371 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386c03-aaa0-42dc-be1f-af2b1718e168 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.328075 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.328782 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.329133 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.329476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] PATH_INFO: `/v3/projects/8ab549dc313847c39c994e30d7658741` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.330638 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab549dc313847c39c994e30d7658741)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.332819 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.361574 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:34.385143 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab549dc313847c39c994e30d7658741', 'request_id': 'req-b4a36cb8-6498-4d97-ba19-338778db2a5a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:34.391064 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab549dc313847c39c994e30d7658741', 'request_id': 'req-b4a36cb8-6498-4d97-ba19-338778db2a5a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:34.397667 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab549dc313847c39c994e30d7658741', 'request_id': 'req-b4a36cb8-6498-4d97-ba19-338778db2a5a'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:34.407692 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] The token cache is being invalidate because project 8ab549dc313847c39c994e30d7658741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:34.407984 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:34.408606 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-b4a36cb8-6498-4d97-ba19-338778db2a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:34.410100 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1451/2926] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:34 2022] DELETE /identity/v3/projects/8ab549dc313847c39c994e30d7658741 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 10:49:34.415038 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b00e-11c0-4aff-b590-236c99dabe44 None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.415497 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b00e-11c0-4aff-b590-236c99dabe44 None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.415674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b00e-11c0-4aff-b590-236c99dabe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.435225 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-a711b00e-11c0-4aff-b590-236c99dabe44 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:34.436457 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-a711b00e-11c0-4aff-b590-236c99dabe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:34.496276 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1476/2927] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:34.504187 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2060-a2f6-4def-87f3-2a006556dfeb None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.504473 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2060-a2f6-4def-87f3-2a006556dfeb None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.504748 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2060-a2f6-4def-87f3-2a006556dfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.525343 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-f1ef2060-a2f6-4def-87f3-2a006556dfeb None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:34.526540 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-f1ef2060-a2f6-4def-87f3-2a006556dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:34.534345 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1452/2928] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:34.539081 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b00e-11c0-4aff-b590-236c99dabe44 None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.548722 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b00e-11c0-4aff-b590-236c99dabe44 None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.554049 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.554632 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.554911 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.555183 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] PATH_INFO: `/v3/domains` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.555848 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 10:49:34.556148 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.557728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.569305 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1477/2929] 10.222.0.16 () {58 vars in 1153 bytes} [Mon Sep 5 10:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 10:49:34.573839 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2060-a2f6-4def-87f3-2a006556dfeb None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.583152 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2060-a2f6-4def-87f3-2a006556dfeb None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.587973 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.588562 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.588842 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.589115 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.589750 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.591675 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.618836 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1453/2930] 10.222.0.16 () {60 vars in 1153 bytes} [Mon Sep 5 10:49:34 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:34.622896 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.633350 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45b842-2f07-42d6-b8cc-67ab20d3013d admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.666042 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:34.691781 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.692390 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.692674 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.692956 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] PATH_INFO: `/v3/users` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.693718 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.695710 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.716392 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1478/2931] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Sep 5 10:49:34 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 10:49:34.720529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.741436 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c48d-4ffd-44f2-9272-ab31b8b179e1 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.746328 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.746924 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.747206 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.747476 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.748164 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.749757 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.759909 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1454/2932] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:34.763799 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.773764 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f2578-2979-40ba-a1d2-5eec24d7ee19 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.778371 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478840a-d471-4b65-bf31-f5125d9c1777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.778959 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478840a-d471-4b65-bf31-f5125d9c1777 admin admin] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.779245 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478840a-d471-4b65-bf31-f5125d9c1777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.779518 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478840a-d471-4b65-bf31-f5125d9c1777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.780187 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478840a-d471-4b65-bf31-f5125d9c1777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.781782 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478840a-d471-4b65-bf31-f5125d9c1777 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.792111 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1479/2933] 10.222.0.16 () {58 vars in 1122 bytes} [Mon Sep 5 10:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 10:49:34.796079 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.806826 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662f2a0-1349-4f89-a088-280718c51eaa admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:34.811500 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:34.812174 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.812459 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.812737 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] PATH_INFO: `/v3/projects/010d5caeb1224c23a0e5f246cb94df30/users/6680650b10894639b62113c1c33f2cb7/roles/6491db22b7294223a5a590b58c543f4c` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.827323 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010d5caeb1224c23a0e5f246cb94df30, user_id=6680650b10894639b62113c1c33f2cb7, role_id=6491db22b7294223a5a590b58c543f4c)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:34.830031 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:34.843683 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1455/2934] 10.222.0.16 () {60 vars in 1483 bytes} [Mon Sep 5 10:49:34 2022] PUT /identity/v3/projects/010d5caeb1224c23a0e5f246cb94df30/users/6680650b10894639b62113c1c33f2cb7/roles/6491db22b7294223a5a590b58c543f4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:34.854290 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08277e38-9568-4001-8910-4c5556fb9f4a None None] REQUEST_METHOD: `POST` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:34.854577 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08277e38-9568-4001-8910-4c5556fb9f4a None None] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:34.854854 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08277e38-9568-4001-8910-4c5556fb9f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:34.885051 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.auth.core [None req-08277e38-9568-4001-8910-4c5556fb9f4a None None] MFA Rules not processed for user `6680650b10894639b62113c1c33f2cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:34.886287 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-08277e38-9568-4001-8910-4c5556fb9f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:34.949744 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1480/2935] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:34.962314 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:34.964117 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:35.040542 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb083b0-8fe1-4650-b041-05e801be2c67 admin admin] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:35.044194 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47106ea-b878-4bb0-8749-3da6f37b5c44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717ade6a084349a8864cf15ce0d827fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:35.044806 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47106ea-b878-4bb0-8749-3da6f37b5c44 service glance] REQUEST_METHOD: `GET` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:35.045088 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47106ea-b878-4bb0-8749-3da6f37b5c44 service glance] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:35.045364 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47106ea-b878-4bb0-8749-3da6f37b5c44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:35.053608 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47106ea-b878-4bb0-8749-3da6f37b5c44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:35.055029 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47106ea-b878-4bb0-8749-3da6f37b5c44 service glance] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:35.063677 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1456/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:44.946779 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:45.059764 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=77,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:49:57.883387 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08277e38-9568-4001-8910-4c5556fb9f4a None None] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:57.945022 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08277e38-9568-4001-8910-4c5556fb9f4a None None] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:57.949471 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:57.950095 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:57.950372 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:57.950640 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] PATH_INFO: `/v3/users/6680650b10894639b62113c1c33f2cb7` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:57.951815 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6680650b10894639b62113c1c33f2cb7)` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:57.953728 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:58.001153 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6680650b10894639b62113c1c33f2cb7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.001825 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6680650b10894639b62113c1c33f2cb7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.014025 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6680650b10894639b62113c1c33f2cb7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.021126 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6680650b10894639b62113c1c33f2cb7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.022097 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.notifications [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6680650b10894639b62113c1c33f2cb7'} {{(pid=81474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.033952 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1481/2937] 10.222.0.16 () {58 vars in 1224 bytes} [Mon Sep 5 10:49:57 2022] DELETE /identity/v3/users/6680650b10894639b62113c1c33f2cb7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:49:58.039040 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] REQUEST_METHOD: `POST` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:58.039561 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:58.039693 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:58.059204 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.auth.core [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] MFA Rules not processed for user `3cec9f43d2034445ba2c8aa17cc5e9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 10:49:58.060429 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:58.121929 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1457/2938] 10.222.0.16 () {58 vars in 958 bytes} [Mon Sep 5 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 10:49:58.133484 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:58.134882 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:58.192660 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ea3d5-88c1-49ee-82a7-af5c6d074361 admin admin] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:58.196776 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f6af1603974cdba70d0d7d78e6777d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:58.197377 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:58.197655 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:58.197928 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:58.206900 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:58.208369 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:58.218487 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1482/2939] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:49:58.477529 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] Authenticating user token {{(pid=81472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:49:58.478992 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.fernet_utils [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:49:58.491024 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724dde7-9987-4249-bd78-f86f1ac14bd3 None None] Validating token access rules against request {{(pid=81472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:49:58.496533 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cec9f43d2034445ba2c8aa17cc5e9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5319c7dfcf94967b47c42ebfecd5d8f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:49:58.497419 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:49:58.497703 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:49:58.497981 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] PATH_INFO: `/v3/projects/010d5caeb1224c23a0e5f246cb94df30` {{(pid=81472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:49:58.499160 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=010d5caeb1224c23a0e5f246cb94df30)` {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:49:58.502409 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] RBAC: Authorization granted {{(pid=81472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:49:58.550804 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010d5caeb1224c23a0e5f246cb94df30', 'request_id': 'req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.557353 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010d5caeb1224c23a0e5f246cb94df30', 'request_id': 'req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.563865 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010d5caeb1224c23a0e5f246cb94df30', 'request_id': 'req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc'} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.574753 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] The token cache is being invalidate because project 010d5caeb1224c23a0e5f246cb94df30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 10:49:58.575045 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.575733 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG keystone.notifications [None req-3ca875fd-82e0-4ef6-8a36-a6ac3680d8dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 10:49:58.577214 dv-cinder-850831-4-smb devstack@keystone.service[81472]: [pid: 81472|app: 0|req: 1458/2940] 10.222.0.16 () {58 vars in 1233 bytes} [Mon Sep 5 10:49:58 2022] DELETE /identity/v3/projects/010d5caeb1224c23a0e5f246cb94df30 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 10:50:08.214396 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:50:08.571674 dv-cinder-850831-4-smb devstack@keystone.service[81472]: DEBUG dbcounter [-] [81472] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 10:52:36.591826 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] Authenticating user token {{(pid=81474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 10:52:36.593254 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:52:36.661547 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a938-b3db-409f-89bc-9750eda760ab service neutron] Validating token access rules against request {{(pid=81474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 10:52:36.722180 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d99cb-2a4a-422a-b4ad-adc97bb70aaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1f8f4eb1c444edb1c197db41cd6f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f670453166984725b3361f82ce283c4b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 10:52:36.722787 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d99cb-2a4a-422a-b4ad-adc97bb70aaf service placement] REQUEST_METHOD: `GET` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 10:52:36.723068 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d99cb-2a4a-422a-b4ad-adc97bb70aaf service placement] SCRIPT_NAME: `/identity` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 10:52:36.723341 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d99cb-2a4a-422a-b4ad-adc97bb70aaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 10:52:36.725102 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.fernet_utils [None req-404d99cb-2a4a-422a-b4ad-adc97bb70aaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 10:52:36.736639 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d99cb-2a4a-422a-b4ad-adc97bb70aaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 10:52:36.738282 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d99cb-2a4a-422a-b4ad-adc97bb70aaf service placement] RBAC: Authorization granted {{(pid=81474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 10:52:36.749403 dv-cinder-850831-4-smb devstack@keystone.service[81474]: [pid: 81474|app: 0|req: 1483/2941] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Sep 5 10:52:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 10:52:46.744794 dv-cinder-850831-4-smb devstack@keystone.service[81474]: DEBUG dbcounter [-] [81474] Writing DB stats keystone:SELECT=58 {{(pid=81474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}